Artificial Intelligence Nanodegree

Convolutional Neural Networks

Project: Write an Algorithm for a Dog Identification App

In this notebook, some template code has already been provided for you, and you will need to implement additional functionality to successfully complete this project. You will not need to modify the included code beyond what is requested. Sections that begin with '(IMPLEMENTATION)' in the header indicate that the following block of code will require additional functionality which you must provide. Instructions will be provided for each section, and the specifics of the implementation are marked in the code block with a 'TODO' statement. Please be sure to read the instructions carefully!

Note: Once you have completed all of the code implementations, you need to finalize your work by exporting the iPython Notebook as an HTML document. Before exporting the notebook to html, all of the code cells need to have been run so that reviewers can see the final implementation and output. You can then export the notebook by using the menu above and navigating to \n", "File -> Download as -> HTML (.html). Include the finished document along with this notebook as your submission.

In addition to implementing code, there will be questions that you must answer which relate to the project and your implementation. Each section where you will answer a question is preceded by a 'Question X' header. Carefully read each question and provide thorough answers in the following text boxes that begin with 'Answer:'. Your project submission will be evaluated based on your answers to each of the questions and the implementation you provide.

Note: Code and Markdown cells can be executed using the Shift + Enter keyboard shortcut. Markdown cells can be edited by double-clicking the cell to enter edit mode.

The rubric contains optional "Stand Out Suggestions" for enhancing the project beyond the minimum requirements. If you decide to pursue the "Stand Out Suggestions", you should include the code in this IPython notebook.

Why We're Here

In this notebook, you will make the first steps towards developing an algorithm that could be used as part of a mobile or web app. At the end of this project, your code will accept any user-supplied image as input. If a dog is detected in the image, it will provide an estimate of the dog's breed. If a human is detected, it will provide an estimate of the dog breed that is most resembling. The image below displays potential sample output of your finished project (... but we expect that each student's algorithm will behave differently!).

Sample Dog Output

In this real-world setting, you will need to piece together a series of models to perform different tasks; for instance, the algorithm that detects humans in an image will be different from the CNN that infers dog breed. There are many points of possible failure, and no perfect algorithm exists. Your imperfect solution will nonetheless create a fun user experience!

The Road Ahead

We break the notebook into separate steps. Feel free to use the links below to navigate the notebook.

  • Step 0: Import Datasets
  • Step 1: Detect Humans
  • Step 2: Detect Dogs
  • Step 3: Create a CNN to Classify Dog Breeds (from Scratch)
  • Step 4: Use a CNN to Classify Dog Breeds (using Transfer Learning)
  • Step 5: Create a CNN to Classify Dog Breeds (using Transfer Learning)
  • Step 6: Write your Algorithm
  • Step 7: Test Your Algorithm

Step 0: Import Datasets

Import Dog Dataset

In the code cell below, we import a dataset of dog images. We populate a few variables through the use of the load_files function from the scikit-learn library:

  • train_files, valid_files, test_files - numpy arrays containing file paths to images
  • train_targets, valid_targets, test_targets - numpy arrays containing onehot-encoded classification labels
  • dog_names - list of string-valued dog breed names for translating labels
In [5]:
from sklearn.datasets import load_files       
from keras.utils import np_utils
import numpy as np
from glob import glob

# define function to load train, test, and validation datasets
def load_dataset(path):
    data = load_files(path)
    dog_files = np.array(data['filenames'])
    dog_targets = np_utils.to_categorical(np.array(data['target']), 133)
    return dog_files, dog_targets

# load train, test, and validation datasets
train_files, train_targets = load_dataset('dogImages/train')
valid_files, valid_targets = load_dataset('dogImages/valid')
test_files, test_targets = load_dataset('dogImages/test')

# load list of dog names
dog_names = [item[20:-1] for item in sorted(glob("dogImages/train/*/"))]

# print statistics about the dataset
print('There are %d total dog categories.' % len(dog_names))
print('There are %s total dog images.\n' % len(np.hstack([train_files, valid_files, test_files])))
print('There are %d training dog images.' % len(train_files))
print('There are %d validation dog images.' % len(valid_files))
print('There are %d test dog images.'% len(test_files))

There are 133 total dog categories.
There are 8351 total dog images.

There are 6680 training dog images.
There are 835 validation dog images.
There are 836 test dog images.

Import Human Dataset

In the code cell below, we import a dataset of human images, where the file paths are stored in the numpy array human_files.

In [6]:
import random
random.seed(8675309)

# load filenames in shuffled human dataset
human_files = np.array(glob("lfw/*/*"))
random.shuffle(human_files)

# print statistics about the dataset
print('There are %d total human images.' % len(human_files))

There are 13234 total human images.

Step 1: Detect Humans

We use OpenCV's implementation of Haar feature-based cascade classifiers to detect human faces in images. OpenCV provides many pre-trained face detectors, stored as XML files on github. We have downloaded one of these detectors and stored it in the haarcascades directory.

In the next code cell, we demonstrate how to use this detector to find human faces in a sample image.

In [7]:
import cv2                
import matplotlib.pyplot as plt                        
%matplotlib inline                               

# extract pre-trained face detector
face_cascade = cv2.CascadeClassifier('haarcascades/haarcascade_frontalface_alt.xml')

# load color (BGR) image
img = cv2.imread(human_files[3])
# convert BGR image to grayscale
gray = cv2.cvtColor(img, cv2.COLOR_BGR2GRAY)

# find faces in image
faces = face_cascade.detectMultiScale(gray)

# print number of faces detected in the image
print('Number of faces detected:', len(faces))

# get bounding box for each detected face
for (x,y,w,h) in faces:
    # add bounding box to color image
    cv2.rectangle(img,(x,y),(x+w,y+h),(255,0,0),2)
    
# convert BGR image to RGB for plotting
cv_rgb = cv2.cvtColor(img, cv2.COLOR_BGR2RGB)

# display the image, along with bounding box
plt.imshow(cv_rgb)
plt.show()

Number of faces detected: 1

Before using any of the face detectors, it is standard procedure to convert the images to grayscale. The detectMultiScale function executes the classifier stored in face_cascade and takes the grayscale image as a parameter.

In the above code, faces is a numpy array of detected faces, where each row corresponds to a detected face. Each detected face is a 1D array with four entries that specifies the bounding box of the detected face. The first two entries in the array (extracted in the above code as x and y) specify the horizontal and vertical positions of the top left corner of the bounding box. The last two entries in the array (extracted here as w and h) specify the width and height of the box.

Write a Human Face Detector

We can use this procedure to write a function that returns True if a human face is detected in an image and False otherwise. This function, aptly named face_detector, takes a string-valued file path to an image as input and appears in the code block below.

In [8]:
# returns "True" if face is detected in image stored at img_path
def face_detector(img_path):
    img = cv2.imread(img_path)
    gray = cv2.cvtColor(img, cv2.COLOR_BGR2GRAY)
    faces = face_cascade.detectMultiScale(gray)
    return len(faces) > 0

(IMPLEMENTATION) Assess the Human Face Detector

Question 1: Use the code cell below to test the performance of the face_detector function.

  • What percentage of the first 100 images in human_files have a detected human face?
  • What percentage of the first 100 images in dog_files have a detected human face?

Ideally, we would like 100% of human images with a detected face and 0% of dog images with a detected face. You will see that our algorithm falls short of this goal, but still gives acceptable performance. We extract the file paths for the first 100 images from each of the datasets and store them in the numpy arrays human_files_short and dog_files_short.

Answer: There are faces detected in 97% of the 100 given human files. Also 11% human faces detected in the dog_files.

In [9]:
human_files_short = human_files[:100]
dog_files_short = train_files[:100]
# Do NOT modify the code above this line.

## TODO: Test the performance of the face_detector algorithm 
## on the images in human_files_short and dog_files_short.

faces_vfunc = np.vectorize (face_detector)

human_faces = faces_vfunc(human_files_short)
dog_faces = faces_vfunc(dog_files_short)

print('Faces detected in {:.2f}% of the human sample set.'.format((sum(human_faces)/len(human_faces))*100))

print ('Faces deteceted in {:.2f}% of the dog Sample set.'. format ((sum(dog_faces)/len(dog_faces))*100))

Faces detected in 97.00% of the human sample set.
Faces deteceted in 11.00% of the dog Sample set.

Question 2: This algorithmic choice necessitates that we communicate to the user that we accept human images only when they provide a clear view of a face (otherwise, we risk having unneccessarily frustrated users!). In your opinion, is this a reasonable expectation to pose on the user? If not, can you think of a way to detect humans in images that does not necessitate an image with a clearly presented face?

Answer: In my opinion this is a reasonable expectation to pose on the user. Tho expect that the algorithm can detect people's profiles or the back of a head would be unreasonable. Therefore the algorithm is called face detector. In order to detect people in images it would be reasonable to focus on certain features of humans. This could be the nose, eyes, ears, mouth. If the algorithm detects one of this features it could predict that there is a person in the image.

We suggest the face detector from OpenCV as a potential way to detect human images in your algorithm, but you are free to explore other approaches, especially approaches that make use of deep learning :). Please use the code cell below to design and test your own face detection algorithm. If you decide to pursue this optional task, report performance on each of the datasets.

In [ ]:
## (Optional) TODO: Report the performance of another  
## face detection algorithm on the LFW dataset
### Feel free to use as many code cells as needed.

Step 2: Detect Dogs

In this section, we use a pre-trained ResNet-50 model to detect dogs in images. Our first line of code downloads the ResNet-50 model, along with weights that have been trained on ImageNet, a very large, very popular dataset used for image classification and other vision tasks. ImageNet contains over 10 million URLs, each linking to an image containing an object from one of 1000 categories. Given an image, this pre-trained ResNet-50 model returns a prediction (derived from the available categories in ImageNet) for the object that is contained in the image.

In [11]:
from keras.applications.resnet50 import ResNet50

# define ResNet50 model
ResNet50_model = ResNet50(weights='imagenet')

Pre-process the Data

When using TensorFlow as backend, Keras CNNs require a 4D array (which we'll also refer to as a 4D tensor) as input, with shape

$$ (\text{nb_samples}, \text{rows}, \text{columns}, \text{channels}), $$

where nb_samples corresponds to the total number of images (or samples), and rows, columns, and channels correspond to the number of rows, columns, and channels for each image, respectively.

The path_to_tensor function below takes a string-valued file path to a color image as input and returns a 4D tensor suitable for supplying to a Keras CNN. The function first loads the image and resizes it to a square image that is $224 \times 224$ pixels. Next, the image is converted to an array, which is then resized to a 4D tensor. In this case, since we are working with color images, each image has three channels. Likewise, since we are processing a single image (or sample), the returned tensor will always have shape

$$ (1, 224, 224, 3). $$

The paths_to_tensor function takes a numpy array of string-valued image paths as input and returns a 4D tensor with shape

$$ (\text{nb_samples}, 224, 224, 3). $$

Here, nb_samples is the number of samples, or number of images, in the supplied array of image paths. It is best to think of nb_samples as the number of 3D tensors (where each 3D tensor corresponds to a different image) in your dataset!

In [12]:
from keras.preprocessing import image                  
from tqdm import tqdm

def path_to_tensor(img_path):
    # loads RGB image as PIL.Image.Image type
    img = image.load_img(img_path, target_size=(224, 224))
    # convert PIL.Image.Image type to 3D tensor with shape (224, 224, 3)
    x = image.img_to_array(img)
    # convert 3D tensor to 4D tensor with shape (1, 224, 224, 3) and return 4D tensor
    return np.expand_dims(x, axis=0)

def paths_to_tensor(img_paths):
    list_of_tensors = [path_to_tensor(img_path) for img_path in tqdm(img_paths)]
    return np.vstack(list_of_tensors)

Making Predictions with ResNet-50

Getting the 4D tensor ready for ResNet-50, and for any other pre-trained model in Keras, requires some additional processing. First, the RGB image is converted to BGR by reordering the channels. All pre-trained models have the additional normalization step that the mean pixel (expressed in RGB as $[103.939, 116.779, 123.68]$ and calculated from all pixels in all images in ImageNet) must be subtracted from every pixel in each image. This is implemented in the imported function preprocess_input. If you're curious, you can check the code for preprocess_input here.

Now that we have a way to format our image for supplying to ResNet-50, we are now ready to use the model to extract the predictions. This is accomplished with the predict method, which returns an array whose $i$-th entry is the model's predicted probability that the image belongs to the $i$-th ImageNet category. This is implemented in the ResNet50_predict_labels function below.

By taking the argmax of the predicted probability vector, we obtain an integer corresponding to the model's predicted object class, which we can identify with an object category through the use of this dictionary.

In [13]:
from keras.applications.resnet50 import preprocess_input, decode_predictions

def ResNet50_predict_labels(img_path):
    # returns prediction vector for image located at img_path
    img = preprocess_input(path_to_tensor(img_path))
    return np.argmax(ResNet50_model.predict(img))

Write a Dog Detector

While looking at the dictionary, you will notice that the categories corresponding to dogs appear in an uninterrupted sequence and correspond to dictionary keys 151-268, inclusive, to include all categories from 'Chihuahua' to 'Mexican hairless'. Thus, in order to check to see if an image is predicted to contain a dog by the pre-trained ResNet-50 model, we need only check if the ResNet50_predict_labels function above returns a value between 151 and 268 (inclusive).

We use these ideas to complete the dog_detector function below, which returns True if a dog is detected in an image (and False if not).

In [14]:
### returns "True" if a dog is detected in the image stored at img_path
def dog_detector(img_path):
    prediction = ResNet50_predict_labels(img_path)
    return ((prediction <= 268) & (prediction >= 151))

(IMPLEMENTATION) Assess the Dog Detector

Question 3: Use the code cell below to test the performance of your dog_detector function.

  • What percentage of the images in human_files_short have a detected dog?
  • What percentage of the images in dog_files_short have a detected dog?

Answer: The dog detector only detects 2% of the humans as dogs.

In [15]:
### TODO: Test the performance of the dog_detector function
### on the images in human_files_short and dog_files_short.
dog_vfunc = np.vectorize (dog_detector)

human_file = dog_vfunc(human_files_short)
dog_file = dog_vfunc(dog_files_short)


print('Faces detected in {:.2f}% of the human sample set.'.format((sum(human_file)/len(human_file))*100))

print('Faces deteceted in {:.2f}% of the dog Sample set.'. format ((sum(dog_file)/len(dog_file))*100))

Faces detected in 2.00% of the human sample set.
Faces deteceted in 100.00% of the dog Sample set.

Step 3: Create a CNN to Classify Dog Breeds (from Scratch)

Now that we have functions for detecting humans and dogs in images, we need a way to predict breed from images. In this step, you will create a CNN that classifies dog breeds. You must create your CNN from scratch (so, you can't use transfer learning yet!), and you must attain a test accuracy of at least 1%. In Step 5 of this notebook, you will have the opportunity to use transfer learning to create a CNN that attains greatly improved accuracy.

Be careful with adding too many trainable layers! More parameters means longer training, which means you are more likely to need a GPU to accelerate the training process. Thankfully, Keras provides a handy estimate of the time that each epoch is likely to take; you can extrapolate this estimate to figure out how long it will take for your algorithm to train.

We mention that the task of assigning breed to dogs from images is considered exceptionally challenging. To see why, consider that even a human would have great difficulty in distinguishing between a Brittany and a Welsh Springer Spaniel.

Brittany Welsh Springer Spaniel

It is not difficult to find other dog breed pairs with minimal inter-class variation (for instance, Curly-Coated Retrievers and American Water Spaniels).

Curly-Coated Retriever American Water Spaniel

Likewise, recall that labradors come in yellow, chocolate, and black. Your vision-based algorithm will have to conquer this high intra-class variation to determine how to classify all of these different shades as the same breed.

Yellow Labrador Chocolate Labrador Black Labrador

We also mention that random chance presents an exceptionally low bar: setting aside the fact that the classes are slightly imabalanced, a random guess will provide a correct answer roughly 1 in 133 times, which corresponds to an accuracy of less than 1%.

Remember that the practice is far ahead of the theory in deep learning. Experiment with many different architectures, and trust your intuition. And, of course, have fun!

Pre-process the Data

We rescale the images by dividing every pixel in every image by 255.

In [16]:
from PIL import ImageFile                            
ImageFile.LOAD_TRUNCATED_IMAGES = True                 

# pre-process the data for Keras
train_tensors = paths_to_tensor(train_files).astype('float32')/255
valid_tensors = paths_to_tensor(valid_files).astype('float32')/255
test_tensors = paths_to_tensor(test_files).astype('float32')/255

100%|██████████████████████████████████████████████████████████████████████████████| 6680/6680 [10:51<00:00, 10.26it/s]
100%|████████████████████████████████████████████████████████████████████████████████| 835/835 [02:11<00:00, 13.09it/s]
100%|████████████████████████████████████████████████████████████████████████████████| 836/836 [01:38<00:00,  7.54it/s]

(IMPLEMENTATION) Model Architecture

Create a CNN to classify dog breed. At the end of your code cell block, summarize the layers of your model by executing the line:

    model.summary()

We have imported some Python modules to get you started, but feel free to import as many modules as you need. If you end up getting stuck, here's a hint that specifies a model that trains relatively fast on CPU and attains >1% test accuracy in 5 epochs:

Sample CNN

Question 4: Outline the steps you took to get to your final CNN architecture and your reasoning at each step. If you chose to use the hinted architecture above, describe why you think that CNN architecture should work well for the image classification task.

Answer: I am using different layers to extract the features from the images. Therefore in each Conv2D layer the the filters are halfed. The following MaxPooling2D layers allow the model to extract more complex features. With the more complex features it is possible to make the model understand differences between different dog breeds. The average pooling layer is used to reduce the complexity and identitfy low level features in the neighbourhood. The fropout layer prevent overfitting. The relu function is used in the dense layer. In order to classify the output into 133 categories the output layer is built with a softmax activation.

In [37]:
from keras.layers import Conv2D, MaxPooling2D, GlobalAveragePooling2D
from keras.layers import Dropout, Flatten, Dense
from keras.models import Sequential

model = Sequential()

model.add(Conv2D(filters=8, kernel_size=2, input_shape=(224, 224, 3), activation='relu'))
model.add(MaxPooling2D(pool_size=2, data_format='channels_last'))
model.add(Conv2D(filters=16, kernel_size=2, activation='relu'))
model.add(MaxPooling2D(pool_size=2, data_format='channels_last'))
model.add(Conv2D(filters=64, kernel_size=2, activation='relu'))
model.add(MaxPooling2D(pool_size=2, data_format='channels_last'))
model.add(GlobalAveragePooling2D())
model.add(Dropout(0.2))
model.add(Dense(500, activation='relu'))
model.add(Dropout(0.4))
model.add(Dense(133, activation='softmax'))

model.summary()

_________________________________________________________________
Layer (type)                 Output Shape              Param #   
=================================================================
conv2d_34 (Conv2D)           (None, 223, 223, 8)       104       
_________________________________________________________________
max_pooling2d_33 (MaxPooling (None, 111, 111, 8)       0         
_________________________________________________________________
conv2d_35 (Conv2D)           (None, 110, 110, 16)      528       
_________________________________________________________________
max_pooling2d_34 (MaxPooling (None, 55, 55, 16)        0         
_________________________________________________________________
conv2d_36 (Conv2D)           (None, 54, 54, 64)        4160      
_________________________________________________________________
max_pooling2d_35 (MaxPooling (None, 27, 27, 64)        0         
_________________________________________________________________
global_average_pooling2d_12  (None, 64)                0         
_________________________________________________________________
dropout_6 (Dropout)          (None, 64)                0         
_________________________________________________________________
dense_13 (Dense)             (None, 500)               32500     
_________________________________________________________________
dropout_7 (Dropout)          (None, 500)               0         
_________________________________________________________________
dense_14 (Dense)             (None, 133)               66633     
=================================================================
Total params: 103,925.0
Trainable params: 103,925.0
Non-trainable params: 0.0
_________________________________________________________________
### Compile the Model
In [40]:
model.compile(optimizer='rmsprop', loss='categorical_crossentropy', metrics=['accuracy'])

(IMPLEMENTATION) Train the Model

Train your model in the code cell below. Use model checkpointing to save the model that attains the best validation loss.

You are welcome to augment the training data, but this is not a requirement.

In [41]:
from keras.callbacks import ModelCheckpoint  

### TODO: specify the number of epochs that you would like to use to train the model.

epochs = 5

### Do NOT modify the code below this line.

checkpointer = ModelCheckpoint(filepath='saved_models/weights.best.from_scratch.hdf5', 
                               verbose=1, save_best_only=True)

model.fit(train_tensors, train_targets, 
          validation_data=(valid_tensors, valid_targets),
          epochs=epochs, batch_size=20, callbacks=[checkpointer], verbose=1)

Train on 6680 samples, validate on 835 samples
Epoch 1/5
6660/6680 [============================>.] - ETA: 16298s - loss: 4.8885 - acc: 0.0000e+00 - ETA: 8403s - loss: 4.8964 - acc: 0.0000e+00  - ETA: 5783s - loss: 4.8943 - acc: 0.0167     - ETA: 4447s - loss: 4.8940 - acc: 0.0125 - ETA: 3661s - loss: 4.8938 - acc: 0.0100 - ETA: 3123s - loss: 4.8954 - acc: 0.0083 - ETA: 2743s - loss: 4.8920 - acc: 0.0071 - ETA: 2463s - loss: 4.8941 - acc: 0.0063 - ETA: 2277s - loss: 4.8891 - acc: 0.0056 - ETA: 2102s - loss: 4.8931 - acc: 0.0050 - ETA: 1953s - loss: 4.8936 - acc: 0.0045 - ETA: 1830s - loss: 4.8935 - acc: 0.0042 - ETA: 1718s - loss: 4.8919 - acc: 0.0038 - ETA: 1628s - loss: 4.8934 - acc: 0.0036 - ETA: 1550s - loss: 4.8944 - acc: 0.0033 - ETA: 1480s - loss: 4.8941 - acc: 0.0063 - ETA: 1419s - loss: 4.8957 - acc: 0.0059 - ETA: 1367s - loss: 4.8957 - acc: 0.0056 - ETA: 1319s - loss: 4.8973 - acc: 0.0053 - ETA: 1274s - loss: 4.8984 - acc: 0.0050 - ETA: 1233s - loss: 4.8987 - acc: 0.0048 - ETA: 1197s - loss: 4.8990 - acc: 0.0045 - ETA: 1162s - loss: 4.8982 - acc: 0.0065 - ETA: 1132s - loss: 4.8979 - acc: 0.0083 - ETA: 1105s - loss: 4.8978 - acc: 0.0080 - ETA: 1078s - loss: 4.8972 - acc: 0.0077 - ETA: 1055s - loss: 4.8957 - acc: 0.0093 - ETA: 1030s - loss: 4.8955 - acc: 0.0107 - ETA: 1009s - loss: 4.8957 - acc: 0.0121 - ETA: 989s - loss: 4.8959 - acc: 0.0117  - ETA: 974s - loss: 4.8955 - acc: 0.0113 - ETA: 956s - loss: 4.8952 - acc: 0.0125 - ETA: 940s - loss: 4.8956 - acc: 0.0136 - ETA: 925s - loss: 4.8951 - acc: 0.0132 - ETA: 911s - loss: 4.8951 - acc: 0.0129 - ETA: 897s - loss: 4.8953 - acc: 0.0125 - ETA: 887s - loss: 4.8956 - acc: 0.0122 - ETA: 873s - loss: 4.8961 - acc: 0.0132 - ETA: 958s - loss: 4.8955 - acc: 0.0128 - ETA: 942s - loss: 4.8951 - acc: 0.0125 - ETA: 932s - loss: 4.8950 - acc: 0.0122 - ETA: 921s - loss: 4.8951 - acc: 0.0131 - ETA: 910s - loss: 4.8951 - acc: 0.0128 - ETA: 899s - loss: 4.8944 - acc: 0.0125 - ETA: 887s - loss: 4.8945 - acc: 0.0122 - ETA: 876s - loss: 4.8942 - acc: 0.0120 - ETA: 868s - loss: 4.8939 - acc: 0.0117 - ETA: 860s - loss: 4.8941 - acc: 0.0115 - ETA: 849s - loss: 4.8940 - acc: 0.0112 - ETA: 841s - loss: 4.8935 - acc: 0.0120 - ETA: 834s - loss: 4.8935 - acc: 0.0118 - ETA: 826s - loss: 4.8931 - acc: 0.0115 - ETA: 816s - loss: 4.8931 - acc: 0.0113 - ETA: 806s - loss: 4.8936 - acc: 0.0111 - ETA: 843s - loss: 4.8930 - acc: 0.0109 - ETA: 835s - loss: 4.8924 - acc: 0.0125 - ETA: 825s - loss: 4.8924 - acc: 0.0123 - ETA: 816s - loss: 4.8921 - acc: 0.0129 - ETA: 807s - loss: 4.8911 - acc: 0.0144 - ETA: 798s - loss: 4.8911 - acc: 0.0142 - ETA: 789s - loss: 4.8902 - acc: 0.0139 - ETA: 781s - loss: 4.8895 - acc: 0.0137 - ETA: 773s - loss: 4.8893 - acc: 0.0135 - ETA: 767s - loss: 4.8901 - acc: 0.0133 - ETA: 758s - loss: 4.8891 - acc: 0.0131 - ETA: 751s - loss: 4.8891 - acc: 0.0129 - ETA: 743s - loss: 4.8890 - acc: 0.0127 - ETA: 736s - loss: 4.8891 - acc: 0.0125 - ETA: 729s - loss: 4.8888 - acc: 0.0130 - ETA: 723s - loss: 4.8887 - acc: 0.0136 - ETA: 726s - loss: 4.8884 - acc: 0.0134 - ETA: 723s - loss: 4.8884 - acc: 0.0132 - ETA: 718s - loss: 4.8883 - acc: 0.0130 - ETA: 711s - loss: 4.8885 - acc: 0.0128 - ETA: 705s - loss: 4.8880 - acc: 0.0127 - ETA: 699s - loss: 4.8885 - acc: 0.0125 - ETA: 693s - loss: 4.8881 - acc: 0.0130 - ETA: 687s - loss: 4.8878 - acc: 0.0128 - ETA: 680s - loss: 4.8878 - acc: 0.0127 - ETA: 675s - loss: 4.8891 - acc: 0.0125 - ETA: 669s - loss: 4.8895 - acc: 0.0123 - ETA: 664s - loss: 4.8893 - acc: 0.0122 - ETA: 659s - loss: 4.8889 - acc: 0.0120 - ETA: 653s - loss: 4.8889 - acc: 0.0119 - ETA: 647s - loss: 4.8893 - acc: 0.0118 - ETA: 642s - loss: 4.8896 - acc: 0.0116 - ETA: 639s - loss: 4.8897 - acc: 0.0115 - ETA: 634s - loss: 4.8897 - acc: 0.0119 - ETA: 630s - loss: 4.8900 - acc: 0.0118 - ETA: 626s - loss: 4.8900 - acc: 0.0117 - ETA: 621s - loss: 4.8905 - acc: 0.0115 - ETA: 620s - loss: 4.8904 - acc: 0.0114 - ETA: 617s - loss: 4.8899 - acc: 0.0113 - ETA: 612s - loss: 4.8900 - acc: 0.0112 - ETA: 607s - loss: 4.8899 - acc: 0.0111 - ETA: 606s - loss: 4.8891 - acc: 0.0115 - ETA: 604s - loss: 4.8889 - acc: 0.0113 - ETA: 608s - loss: 4.8888 - acc: 0.0112 - ETA: 604s - loss: 4.8887 - acc: 0.0111 - ETA: 599s - loss: 4.8887 - acc: 0.0110 - ETA: 594s - loss: 4.8890 - acc: 0.0109 - ETA: 590s - loss: 4.8890 - acc: 0.0113 - ETA: 585s - loss: 4.8890 - acc: 0.0112 - ETA: 581s - loss: 4.8890 - acc: 0.0115 - ETA: 576s - loss: 4.8891 - acc: 0.0114 - ETA: 575s - loss: 4.8887 - acc: 0.0113 - ETA: 571s - loss: 4.8883 - acc: 0.0112 - ETA: 569s - loss: 4.8880 - acc: 0.0111 - ETA: 565s - loss: 4.8878 - acc: 0.0110 - ETA: 561s - loss: 4.8879 - acc: 0.0109 - ETA: 557s - loss: 4.8885 - acc: 0.0108 - ETA: 553s - loss: 4.8885 - acc: 0.0107 - ETA: 549s - loss: 4.8886 - acc: 0.0106 - ETA: 551s - loss: 4.8886 - acc: 0.0105 - ETA: 547s - loss: 4.8882 - acc: 0.0104 - ETA: 543s - loss: 4.8882 - acc: 0.0103 - ETA: 541s - loss: 4.8882 - acc: 0.0103 - ETA: 539s - loss: 4.8881 - acc: 0.0102 - ETA: 535s - loss: 4.8883 - acc: 0.0101 - ETA: 531s - loss: 4.8885 - acc: 0.0100 - ETA: 527s - loss: 4.8883 - acc: 0.0099 - ETA: 524s - loss: 4.8881 - acc: 0.0098 - ETA: 521s - loss: 4.8881 - acc: 0.0098 - ETA: 518s - loss: 4.8880 - acc: 0.0097 - ETA: 514s - loss: 4.8880 - acc: 0.0096 - ETA: 511s - loss: 4.8886 - acc: 0.0095 - ETA: 507s - loss: 4.8884 - acc: 0.0094 - ETA: 504s - loss: 4.8886 - acc: 0.0094 - ETA: 500s - loss: 4.8890 - acc: 0.0093 - ETA: 497s - loss: 4.8891 - acc: 0.0092 - ETA: 494s - loss: 4.8890 - acc: 0.0095 - ETA: 490s - loss: 4.8887 - acc: 0.0095 - ETA: 490s - loss: 4.8890 - acc: 0.0094 - ETA: 487s - loss: 4.8888 - acc: 0.0097 - ETA: 484s - loss: 4.8885 - acc: 0.0096 - ETA: 481s - loss: 4.8882 - acc: 0.0096 - ETA: 480s - loss: 4.8880 - acc: 0.0102 - ETA: 477s - loss: 4.8884 - acc: 0.0101 - ETA: 474s - loss: 4.8886 - acc: 0.0101 - ETA: 471s - loss: 4.8885 - acc: 0.0100 - ETA: 469s - loss: 4.8884 - acc: 0.0099 - ETA: 465s - loss: 4.8881 - acc: 0.0102 - ETA: 462s - loss: 4.8881 - acc: 0.0101 - ETA: 459s - loss: 4.8877 - acc: 0.0104 - ETA: 456s - loss: 4.8876 - acc: 0.0107 - ETA: 454s - loss: 4.8877 - acc: 0.0106 - ETA: 450s - loss: 4.8880 - acc: 0.0105 - ETA: 450s - loss: 4.8879 - acc: 0.0108 - ETA: 447s - loss: 4.8879 - acc: 0.0107 - ETA: 444s - loss: 4.8877 - acc: 0.0110 - ETA: 441s - loss: 4.8878 - acc: 0.0109 - ETA: 438s - loss: 4.8879 - acc: 0.0109 - ETA: 437s - loss: 4.8876 - acc: 0.0108 - ETA: 435s - loss: 4.8874 - acc: 0.0107 - ETA: 432s - loss: 4.8873 - acc: 0.0106 - ETA: 430s - loss: 4.8874 - acc: 0.0106 - ETA: 427s - loss: 4.8873 - acc: 0.0105 - ETA: 424s - loss: 4.8876 - acc: 0.0104 - ETA: 421s - loss: 4.8875 - acc: 0.0104 - ETA: 419s - loss: 4.8875 - acc: 0.0103 - ETA: 416s - loss: 4.8875 - acc: 0.0102 - ETA: 413s - loss: 4.8874 - acc: 0.0102 - ETA: 410s - loss: 4.8873 - acc: 0.0104 - ETA: 407s - loss: 4.8876 - acc: 0.0104 - ETA: 404s - loss: 4.8875 - acc: 0.0103 - ETA: 400s - loss: 4.8877 - acc: 0.0102 - ETA: 398s - loss: 4.8876 - acc: 0.0102 - ETA: 395s - loss: 4.8875 - acc: 0.0101 - ETA: 392s - loss: 4.8874 - acc: 0.0101 - ETA: 390s - loss: 4.8873 - acc: 0.0100 - ETA: 387s - loss: 4.8872 - acc: 0.0099 - ETA: 384s - loss: 4.8871 - acc: 0.0099 - ETA: 381s - loss: 4.8871 - acc: 0.0101 - ETA: 379s - loss: 4.8871 - acc: 0.0101 - ETA: 376s - loss: 4.8868 - acc: 0.0100 - ETA: 373s - loss: 4.8869 - acc: 0.0099 - ETA: 370s - loss: 4.8869 - acc: 0.0099 - ETA: 367s - loss: 4.8867 - acc: 0.0098 - ETA: 366s - loss: 4.8867 - acc: 0.0098 - ETA: 366s - loss: 4.8865 - acc: 0.0097 - ETA: 364s - loss: 4.8866 - acc: 0.0097 - ETA: 364s - loss: 4.8865 - acc: 0.0099 - ETA: 364s - loss: 4.8867 - acc: 0.0098 - ETA: 363s - loss: 4.8870 - acc: 0.0098 - ETA: 364s - loss: 4.8868 - acc: 0.0097 - ETA: 363s - loss: 4.8865 - acc: 0.0097 - ETA: 363s - loss: 4.8863 - acc: 0.0096 - ETA: 360s - loss: 4.8865 - acc: 0.0096 - ETA: 360s - loss: 4.8868 - acc: 0.0095 - ETA: 358s - loss: 4.8870 - acc: 0.0095 - ETA: 358s - loss: 4.8867 - acc: 0.0094 - ETA: 356s - loss: 4.8871 - acc: 0.0094 - ETA: 355s - loss: 4.8871 - acc: 0.0093 - ETA: 354s - loss: 4.8871 - acc: 0.0093 - ETA: 352s - loss: 4.8871 - acc: 0.0092 - ETA: 350s - loss: 4.8872 - acc: 0.0092 - ETA: 348s - loss: 4.8872 - acc: 0.0091 - ETA: 346s - loss: 4.8871 - acc: 0.0091 - ETA: 344s - loss: 4.8869 - acc: 0.0090 - ETA: 342s - loss: 4.8866 - acc: 0.0090 - ETA: 340s - loss: 4.8867 - acc: 0.0090 - ETA: 338s - loss: 4.8865 - acc: 0.0089 - ETA: 336s - loss: 4.8866 - acc: 0.0089 - ETA: 334s - loss: 4.8864 - acc: 0.0091 - ETA: 332s - loss: 4.8864 - acc: 0.0090 - ETA: 330s - loss: 4.8866 - acc: 0.0090 - ETA: 328s - loss: 4.8864 - acc: 0.0089 - ETA: 327s - loss: 4.8864 - acc: 0.0089 - ETA: 327s - loss: 4.8864 - acc: 0.0089 - ETA: 325s - loss: 4.8861 - acc: 0.0090 - ETA: 323s - loss: 4.8860 - acc: 0.0090 - ETA: 320s - loss: 4.8856 - acc: 0.0092 - ETA: 318s - loss: 4.8856 - acc: 0.0092 - ETA: 316s - loss: 4.8856 - acc: 0.0091 - ETA: 318s - loss: 4.8853 - acc: 0.0091 - ETA: 316s - loss: 4.8855 - acc: 0.0090 - ETA: 313s - loss: 4.8857 - acc: 0.0090 - ETA: 310s - loss: 4.8857 - acc: 0.0089 - ETA: 307s - loss: 4.8860 - acc: 0.0089 - ETA: 304s - loss: 4.8862 - acc: 0.0089 - ETA: 301s - loss: 4.8862 - acc: 0.0088 - ETA: 298s - loss: 4.8860 - acc: 0.0088 - ETA: 295s - loss: 4.8861 - acc: 0.0087 - ETA: 293s - loss: 4.8861 - acc: 0.0087 - ETA: 290s - loss: 4.8860 - acc: 0.0087 - ETA: 288s - loss: 4.8861 - acc: 0.0086 - ETA: 285s - loss: 4.8858 - acc: 0.0090 - ETA: 283s - loss: 4.8857 - acc: 0.0090 - ETA: 280s - loss: 4.8856 - acc: 0.0092 - ETA: 277s - loss: 4.8857 - acc: 0.0093 - ETA: 274s - loss: 4.8857 - acc: 0.0093 - ETA: 272s - loss: 4.8858 - acc: 0.0093 - ETA: 269s - loss: 4.8856 - acc: 0.0094 - ETA: 266s - loss: 4.8855 - acc: 0.0094 - ETA: 263s - loss: 4.8853 - acc: 0.0094 - ETA: 260s - loss: 4.8855 - acc: 0.0093 - ETA: 258s - loss: 4.8854 - acc: 0.0093 - ETA: 256s - loss: 4.8855 - acc: 0.0095 - ETA: 254s - loss: 4.8857 - acc: 0.0094 - ETA: 251s - loss: 4.8856 - acc: 0.0094 - ETA: 249s - loss: 4.8856 - acc: 0.0093 - ETA: 247s - loss: 4.8855 - acc: 0.0093 - ETA: 244s - loss: 4.8856 - acc: 0.0093 - ETA: 242s - loss: 4.8854 - acc: 0.0096 - ETA: 240s - loss: 4.8853 - acc: 0.0098 - ETA: 237s - loss: 4.8855 - acc: 0.0098 - ETA: 235s - loss: 4.8851 - acc: 0.0097 - ETA: 232s - loss: 4.8852 - acc: 0.0097 - ETA: 230s - loss: 4.8853 - acc: 0.0096 - ETA: 228s - loss: 4.8852 - acc: 0.0096 - ETA: 226s - loss: 4.8852 - acc: 0.0096 - ETA: 226s - loss: 4.8851 - acc: 0.0095 - ETA: 223s - loss: 4.8850 - acc: 0.0095 - ETA: 220s - loss: 4.8849 - acc: 0.0094 - ETA: 217s - loss: 4.8847 - acc: 0.0094 - ETA: 215s - loss: 4.8849 - acc: 0.0094 - ETA: 212s - loss: 4.8848 - acc: 0.0093 - ETA: 210s - loss: 4.8848 - acc: 0.0095 - ETA: 207s - loss: 4.8846 - acc: 0.0095 - ETA: 205s - loss: 4.8843 - acc: 0.0094 - ETA: 202s - loss: 4.8844 - acc: 0.0094 - ETA: 199s - loss: 4.8844 - acc: 0.0094 - ETA: 196s - loss: 4.8843 - acc: 0.0095 - ETA: 194s - loss: 4.8842 - acc: 0.0095 - ETA: 191s - loss: 4.8843 - acc: 0.0096 - ETA: 188s - loss: 4.8845 - acc: 0.0096 - ETA: 186s - loss: 4.8846 - acc: 0.0096 - ETA: 183s - loss: 4.8848 - acc: 0.0095 - ETA: 180s - loss: 4.8846 - acc: 0.0095 - ETA: 177s - loss: 4.8844 - acc: 0.0096 - ETA: 174s - loss: 4.8845 - acc: 0.0096 - ETA: 171s - loss: 4.8843 - acc: 0.0096 - ETA: 168s - loss: 4.8844 - acc: 0.0095 - ETA: 165s - loss: 4.8842 - acc: 0.0095 - ETA: 162s - loss: 4.8843 - acc: 0.0095 - ETA: 160s - loss: 4.8844 - acc: 0.0094 - ETA: 157s - loss: 4.8843 - acc: 0.0094 - ETA: 154s - loss: 4.8843 - acc: 0.0094 - ETA: 152s - loss: 4.8844 - acc: 0.0093 - ETA: 149s - loss: 4.8844 - acc: 0.0093 - ETA: 146s - loss: 4.8845 - acc: 0.0093 - ETA: 144s - loss: 4.8845 - acc: 0.0096 - ETA: 141s - loss: 4.8845 - acc: 0.0095 - ETA: 138s - loss: 4.8846 - acc: 0.0095 - ETA: 135s - loss: 4.8845 - acc: 0.0095 - ETA: 132s - loss: 4.8844 - acc: 0.0094 - ETA: 129s - loss: 4.8845 - acc: 0.0096 - ETA: 127s - loss: 4.8845 - acc: 0.0095 - ETA: 124s - loss: 4.8845 - acc: 0.0095 - ETA: 121s - loss: 4.8848 - acc: 0.0095 - ETA: 118s - loss: 4.8848 - acc: 0.0095 - ETA: 116s - loss: 4.8848 - acc: 0.0096 - ETA: 113s - loss: 4.8848 - acc: 0.0096 - ETA: 110s - loss: 4.8849 - acc: 0.0095 - ETA: 108s - loss: 4.8851 - acc: 0.0095 - ETA: 105s - loss: 4.8850 - acc: 0.0095 - ETA: 102s - loss: 4.8849 - acc: 0.0094 - ETA: 100s - loss: 4.8851 - acc: 0.0094 - ETA: 97s - loss: 4.8852 - acc: 0.0094  - ETA: 94s - loss: 4.8853 - acc: 0.0093 - ETA: 91s - loss: 4.8854 - acc: 0.0093 - ETA: 89s - loss: 4.8854 - acc: 0.0093 - ETA: 86s - loss: 4.8853 - acc: 0.0092 - ETA: 83s - loss: 4.8855 - acc: 0.0092 - ETA: 80s - loss: 4.8855 - acc: 0.0092 - ETA: 77s - loss: 4.8855 - acc: 0.0092 - ETA: 74s - loss: 4.8855 - acc: 0.0091 - ETA: 72s - loss: 4.8854 - acc: 0.0091 - ETA: 69s - loss: 4.8854 - acc: 0.0091 - ETA: 66s - loss: 4.8855 - acc: 0.0090 - ETA: 64s - loss: 4.8854 - acc: 0.0090 - ETA: 61s - loss: 4.8854 - acc: 0.0091 - ETA: 58s - loss: 4.8854 - acc: 0.0091 - ETA: 55s - loss: 4.8853 - acc: 0.0091 - ETA: 52s - loss: 4.8852 - acc: 0.0090 - ETA: 50s - loss: 4.8850 - acc: 0.0090 - ETA: 47s - loss: 4.8849 - acc: 0.0090 - ETA: 44s - loss: 4.8849 - acc: 0.0090 - ETA: 41s - loss: 4.8849 - acc: 0.0089 - ETA: 39s - loss: 4.8847 - acc: 0.0089 - ETA: 36s - loss: 4.8847 - acc: 0.0089 - ETA: 33s - loss: 4.8849 - acc: 0.0089 - ETA: 30s - loss: 4.8848 - acc: 0.0088 - ETA: 27s - loss: 4.8847 - acc: 0.0088 - ETA: 25s - loss: 4.8847 - acc: 0.0088 - ETA: 22s - loss: 4.8845 - acc: 0.0087 - ETA: 19s - loss: 4.8846 - acc: 0.0087 - ETA: 16s - loss: 4.8847 - acc: 0.0087 - ETA: 13s - loss: 4.8846 - acc: 0.0087 - ETA: 11s - loss: 4.8846 - acc: 0.0086 - ETA: 8s - loss: 4.8845 - acc: 0.0088  - ETA: 5s - loss: 4.8843 - acc: 0.0087 - ETA: 2s - loss: 4.8840 - acc: 0.0087Epoch 00000: val_loss improved from inf to 4.86677, saving model to saved_models/weights.best.from_scratch.hdf5
6680/6680 [==============================] - 1072s - loss: 4.8841 - acc: 0.0087 - val_loss: 4.8668 - val_acc: 0.0108
Epoch 2/5
6660/6680 [============================>.] - ETA: 1658s - loss: 4.8903 - acc: 0.0000e+00 - ETA: 1402s - loss: 4.9463 - acc: 0.0000e+00 - ETA: 1369s - loss: 4.9283 - acc: 0.0000e+00 - ETA: 1353s - loss: 4.9027 - acc: 0.0125     - ETA: 1293s - loss: 4.9007 - acc: 0.0100 - ETA: 1250s - loss: 4.8931 - acc: 0.0083 - ETA: 1256s - loss: 4.8908 - acc: 0.0071 - ETA: 1350s - loss: 4.8843 - acc: 0.0063 - ETA: 1344s - loss: 4.8830 - acc: 0.0056 - ETA: 1321s - loss: 4.8837 - acc: 0.0050 - ETA: 1285s - loss: 4.8791 - acc: 0.0045 - ETA: 1259s - loss: 4.8789 - acc: 0.0042 - ETA: 1272s - loss: 4.8741 - acc: 0.0038 - ETA: 1242s - loss: 4.8689 - acc: 0.0071 - ETA: 1235s - loss: 4.8706 - acc: 0.0100 - ETA: 1247s - loss: 4.8727 - acc: 0.0156 - ETA: 1227s - loss: 4.8681 - acc: 0.0147 - ETA: 1257s - loss: 4.8633 - acc: 0.0139 - ETA: 1267s - loss: 4.8638 - acc: 0.0132 - ETA: 1278s - loss: 4.8642 - acc: 0.0125 - ETA: 1277s - loss: 4.8625 - acc: 0.0119 - ETA: 1276s - loss: 4.8669 - acc: 0.0114 - ETA: 1282s - loss: 4.8733 - acc: 0.0109 - ETA: 1282s - loss: 4.8762 - acc: 0.0104 - ETA: 1274s - loss: 4.8731 - acc: 0.0100 - ETA: 1267s - loss: 4.8730 - acc: 0.0096 - ETA: 1244s - loss: 4.8701 - acc: 0.0093 - ETA: 1232s - loss: 4.8709 - acc: 0.0089 - ETA: 1242s - loss: 4.8697 - acc: 0.0086 - ETA: 1239s - loss: 4.8689 - acc: 0.0100 - ETA: 1231s - loss: 4.8688 - acc: 0.0097 - ETA: 1242s - loss: 4.8669 - acc: 0.0094 - ETA: 1270s - loss: 4.8677 - acc: 0.0106 - ETA: 1256s - loss: 4.8680 - acc: 0.0103 - ETA: 1249s - loss: 4.8686 - acc: 0.0100 - ETA: 1230s - loss: 4.8681 - acc: 0.0097 - ETA: 1213s - loss: 4.8710 - acc: 0.0108 - ETA: 1198s - loss: 4.8696 - acc: 0.0118 - ETA: 1190s - loss: 4.8700 - acc: 0.0115 - ETA: 1178s - loss: 4.8710 - acc: 0.0113 - ETA: 1166s - loss: 4.8708 - acc: 0.0110 - ETA: 1154s - loss: 4.8701 - acc: 0.0107 - ETA: 1143s - loss: 4.8685 - acc: 0.0116 - ETA: 1134s - loss: 4.8711 - acc: 0.0114 - ETA: 1125s - loss: 4.8698 - acc: 0.0111 - ETA: 1114s - loss: 4.8720 - acc: 0.0109 - ETA: 1105s - loss: 4.8717 - acc: 0.0106 - ETA: 1098s - loss: 4.8711 - acc: 0.0104 - ETA: 1091s - loss: 4.8712 - acc: 0.0102 - ETA: 1082s - loss: 4.8723 - acc: 0.0100 - ETA: 1071s - loss: 4.8712 - acc: 0.0098 - ETA: 1066s - loss: 4.8708 - acc: 0.0096 - ETA: 1060s - loss: 4.8717 - acc: 0.0094 - ETA: 1054s - loss: 4.8708 - acc: 0.0093 - ETA: 1046s - loss: 4.8704 - acc: 0.0091 - ETA: 1039s - loss: 4.8704 - acc: 0.0089 - ETA: 1032s - loss: 4.8700 - acc: 0.0088 - ETA: 1023s - loss: 4.8688 - acc: 0.0086 - ETA: 1022s - loss: 4.8714 - acc: 0.0085 - ETA: 1010s - loss: 4.8723 - acc: 0.0083 - ETA: 1002s - loss: 4.8724 - acc: 0.0082 - ETA: 998s - loss: 4.8726 - acc: 0.0081  - ETA: 992s - loss: 4.8728 - acc: 0.0079 - ETA: 1007s - loss: 4.8731 - acc: 0.0078 - ETA: 1010s - loss: 4.8735 - acc: 0.0077 - ETA: 1002s - loss: 4.8733 - acc: 0.0083 - ETA: 993s - loss: 4.8730 - acc: 0.0082  - ETA: 996s - loss: 4.8738 - acc: 0.0081 - ETA: 998s - loss: 4.8741 - acc: 0.0080 - ETA: 998s - loss: 4.8741 - acc: 0.0079 - ETA: 995s - loss: 4.8740 - acc: 0.0077 - ETA: 994s - loss: 4.8728 - acc: 0.0090 - ETA: 991s - loss: 4.8729 - acc: 0.0089 - ETA: 985s - loss: 4.8731 - acc: 0.0088 - ETA: 979s - loss: 4.8727 - acc: 0.0087 - ETA: 975s - loss: 4.8718 - acc: 0.0086 - ETA: 965s - loss: 4.8722 - acc: 0.0084 - ETA: 955s - loss: 4.8728 - acc: 0.0083 - ETA: 947s - loss: 4.8733 - acc: 0.0082 - ETA: 941s - loss: 4.8725 - acc: 0.0081 - ETA: 932s - loss: 4.8730 - acc: 0.0080 - ETA: 923s - loss: 4.8733 - acc: 0.0079 - ETA: 913s - loss: 4.8730 - acc: 0.0078 - ETA: 904s - loss: 4.8735 - acc: 0.0077 - ETA: 895s - loss: 4.8739 - acc: 0.0076 - ETA: 887s - loss: 4.8729 - acc: 0.0076 - ETA: 878s - loss: 4.8730 - acc: 0.0080 - ETA: 871s - loss: 4.8739 - acc: 0.0080 - ETA: 865s - loss: 4.8738 - acc: 0.0079 - ETA: 868s - loss: 4.8739 - acc: 0.0078 - ETA: 859s - loss: 4.8737 - acc: 0.0082 - ETA: 853s - loss: 4.8738 - acc: 0.0082 - ETA: 845s - loss: 4.8738 - acc: 0.0081 - ETA: 841s - loss: 4.8742 - acc: 0.0080 - ETA: 837s - loss: 4.8737 - acc: 0.0079 - ETA: 832s - loss: 4.8735 - acc: 0.0083 - ETA: 825s - loss: 4.8732 - acc: 0.0082 - ETA: 817s - loss: 4.8732 - acc: 0.0082 - ETA: 810s - loss: 4.8739 - acc: 0.0081 - ETA: 802s - loss: 4.8734 - acc: 0.0080 - ETA: 795s - loss: 4.8736 - acc: 0.0084 - ETA: 787s - loss: 4.8735 - acc: 0.0083 - ETA: 780s - loss: 4.8738 - acc: 0.0083 - ETA: 774s - loss: 4.8733 - acc: 0.0087 - ETA: 767s - loss: 4.8739 - acc: 0.0086 - ETA: 760s - loss: 4.8740 - acc: 0.0085 - ETA: 754s - loss: 4.8741 - acc: 0.0084 - ETA: 773s - loss: 4.8745 - acc: 0.0083 - ETA: 767s - loss: 4.8751 - acc: 0.0083 - ETA: 761s - loss: 4.8755 - acc: 0.0082 - ETA: 755s - loss: 4.8754 - acc: 0.0081 - ETA: 750s - loss: 4.8751 - acc: 0.0080 - ETA: 744s - loss: 4.8754 - acc: 0.0080 - ETA: 738s - loss: 4.8748 - acc: 0.0083 - ETA: 731s - loss: 4.8749 - acc: 0.0083 - ETA: 725s - loss: 4.8745 - acc: 0.0082 - ETA: 720s - loss: 4.8743 - acc: 0.0081 - ETA: 714s - loss: 4.8743 - acc: 0.0081 - ETA: 709s - loss: 4.8753 - acc: 0.0084 - ETA: 703s - loss: 4.8752 - acc: 0.0083 - ETA: 697s - loss: 4.8752 - acc: 0.0083 - ETA: 691s - loss: 4.8750 - acc: 0.0086 - ETA: 685s - loss: 4.8743 - acc: 0.0089 - ETA: 679s - loss: 4.8746 - acc: 0.0089 - ETA: 674s - loss: 4.8746 - acc: 0.0088 - ETA: 668s - loss: 4.8743 - acc: 0.0087 - ETA: 665s - loss: 4.8745 - acc: 0.0087 - ETA: 660s - loss: 4.8747 - acc: 0.0086 - ETA: 655s - loss: 4.8745 - acc: 0.0085 - ETA: 651s - loss: 4.8749 - acc: 0.0085 - ETA: 646s - loss: 4.8747 - acc: 0.0084 - ETA: 641s - loss: 4.8745 - acc: 0.0087 - ETA: 637s - loss: 4.8745 - acc: 0.0090 - ETA: 632s - loss: 4.8748 - acc: 0.0090 - ETA: 627s - loss: 4.8745 - acc: 0.0089 - ETA: 623s - loss: 4.8738 - acc: 0.0088 - ETA: 618s - loss: 4.8734 - acc: 0.0088 - ETA: 612s - loss: 4.8731 - acc: 0.0091 - ETA: 610s - loss: 4.8732 - acc: 0.0090 - ETA: 608s - loss: 4.8734 - acc: 0.0089 - ETA: 607s - loss: 4.8735 - acc: 0.0089 - ETA: 604s - loss: 4.8737 - acc: 0.0088 - ETA: 607s - loss: 4.8737 - acc: 0.0087 - ETA: 603s - loss: 4.8741 - acc: 0.0087 - ETA: 599s - loss: 4.8742 - acc: 0.0086 - ETA: 595s - loss: 4.8738 - acc: 0.0086 - ETA: 590s - loss: 4.8739 - acc: 0.0085 - ETA: 586s - loss: 4.8743 - acc: 0.0084 - ETA: 582s - loss: 4.8741 - acc: 0.0084 - ETA: 577s - loss: 4.8743 - acc: 0.0083 - ETA: 573s - loss: 4.8737 - acc: 0.0083 - ETA: 569s - loss: 4.8736 - acc: 0.0082 - ETA: 566s - loss: 4.8742 - acc: 0.0085 - ETA: 563s - loss: 4.8740 - acc: 0.0084 - ETA: 559s - loss: 4.8739 - acc: 0.0087 - ETA: 556s - loss: 4.8739 - acc: 0.0087 - ETA: 553s - loss: 4.8742 - acc: 0.0092 - ETA: 550s - loss: 4.8740 - acc: 0.0092 - ETA: 549s - loss: 4.8740 - acc: 0.0091 - ETA: 547s - loss: 4.8732 - acc: 0.0094 - ETA: 544s - loss: 4.8727 - acc: 0.0093 - ETA: 541s - loss: 4.8726 - acc: 0.0093 - ETA: 537s - loss: 4.8723 - acc: 0.0092 - ETA: 533s - loss: 4.8724 - acc: 0.0095 - ETA: 529s - loss: 4.8728 - acc: 0.0094 - ETA: 525s - loss: 4.8724 - acc: 0.0093 - ETA: 521s - loss: 4.8723 - acc: 0.0093 - ETA: 516s - loss: 4.8725 - acc: 0.0092 - ETA: 512s - loss: 4.8727 - acc: 0.0092 - ETA: 508s - loss: 4.8728 - acc: 0.0094 - ETA: 504s - loss: 4.8730 - acc: 0.0094 - ETA: 511s - loss: 4.8725 - acc: 0.0096 - ETA: 508s - loss: 4.8728 - acc: 0.0095 - ETA: 505s - loss: 4.8727 - acc: 0.0095 - ETA: 502s - loss: 4.8728 - acc: 0.0094 - ETA: 499s - loss: 4.8725 - acc: 0.0094 - ETA: 495s - loss: 4.8727 - acc: 0.0093 - ETA: 493s - loss: 4.8724 - acc: 0.0093 - ETA: 489s - loss: 4.8725 - acc: 0.0092 - ETA: 485s - loss: 4.8722 - acc: 0.0092 - ETA: 481s - loss: 4.8723 - acc: 0.0091 - ETA: 477s - loss: 4.8719 - acc: 0.0093 - ETA: 473s - loss: 4.8720 - acc: 0.0096 - ETA: 469s - loss: 4.8718 - acc: 0.0095 - ETA: 466s - loss: 4.8717 - acc: 0.0095 - ETA: 464s - loss: 4.8722 - acc: 0.0094 - ETA: 460s - loss: 4.8722 - acc: 0.0094 - ETA: 457s - loss: 4.8721 - acc: 0.0093 - ETA: 455s - loss: 4.8725 - acc: 0.0095 - ETA: 452s - loss: 4.8727 - acc: 0.0095 - ETA: 449s - loss: 4.8728 - acc: 0.0094 - ETA: 445s - loss: 4.8728 - acc: 0.0094 - ETA: 442s - loss: 4.8727 - acc: 0.0093 - ETA: 438s - loss: 4.8724 - acc: 0.0093 - ETA: 435s - loss: 4.8724 - acc: 0.0092 - ETA: 432s - loss: 4.8724 - acc: 0.0092 - ETA: 429s - loss: 4.8728 - acc: 0.0091 - ETA: 427s - loss: 4.8726 - acc: 0.0093 - ETA: 426s - loss: 4.8726 - acc: 0.0093 - ETA: 429s - loss: 4.8725 - acc: 0.0095 - ETA: 426s - loss: 4.8724 - acc: 0.0095 - ETA: 425s - loss: 4.8723 - acc: 0.0094 - ETA: 421s - loss: 4.8719 - acc: 0.0094 - ETA: 417s - loss: 4.8721 - acc: 0.0093 - ETA: 414s - loss: 4.8719 - acc: 0.0093 - ETA: 410s - loss: 4.8722 - acc: 0.0092 - ETA: 407s - loss: 4.8724 - acc: 0.0092 - ETA: 404s - loss: 4.8726 - acc: 0.0091 - ETA: 401s - loss: 4.8727 - acc: 0.0091 - ETA: 398s - loss: 4.8727 - acc: 0.0090 - ETA: 394s - loss: 4.8729 - acc: 0.0090 - ETA: 391s - loss: 4.8729 - acc: 0.0092 - ETA: 387s - loss: 4.8729 - acc: 0.0092 - ETA: 383s - loss: 4.8730 - acc: 0.0093 - ETA: 380s - loss: 4.8730 - acc: 0.0095 - ETA: 376s - loss: 4.8728 - acc: 0.0095 - ETA: 372s - loss: 4.8728 - acc: 0.0097 - ETA: 369s - loss: 4.8729 - acc: 0.0096 - ETA: 366s - loss: 4.8727 - acc: 0.0096 - ETA: 362s - loss: 4.8725 - acc: 0.0095 - ETA: 359s - loss: 4.8724 - acc: 0.0095 - ETA: 355s - loss: 4.8726 - acc: 0.0095 - ETA: 352s - loss: 4.8726 - acc: 0.0094 - ETA: 349s - loss: 4.8724 - acc: 0.0094 - ETA: 349s - loss: 4.8721 - acc: 0.0098 - ETA: 346s - loss: 4.8722 - acc: 0.0100 - ETA: 344s - loss: 4.8721 - acc: 0.0101 - ETA: 340s - loss: 4.8718 - acc: 0.0101 - ETA: 337s - loss: 4.8719 - acc: 0.0100 - ETA: 334s - loss: 4.8721 - acc: 0.0100 - ETA: 330s - loss: 4.8722 - acc: 0.0100 - ETA: 328s - loss: 4.8718 - acc: 0.0099 - ETA: 324s - loss: 4.8721 - acc: 0.0099 - ETA: 321s - loss: 4.8717 - acc: 0.0098 - ETA: 318s - loss: 4.8717 - acc: 0.0098 - ETA: 314s - loss: 4.8715 - acc: 0.0102 - ETA: 311s - loss: 4.8712 - acc: 0.0101 - ETA: 307s - loss: 4.8709 - acc: 0.0101 - ETA: 304s - loss: 4.8711 - acc: 0.0100 - ETA: 300s - loss: 4.8712 - acc: 0.0100 - ETA: 297s - loss: 4.8712 - acc: 0.0104 - ETA: 295s - loss: 4.8714 - acc: 0.0103 - ETA: 293s - loss: 4.8711 - acc: 0.0105 - ETA: 291s - loss: 4.8712 - acc: 0.0107 - ETA: 288s - loss: 4.8712 - acc: 0.0106 - ETA: 285s - loss: 4.8712 - acc: 0.0106 - ETA: 282s - loss: 4.8715 - acc: 0.0105 - ETA: 278s - loss: 4.8712 - acc: 0.0105 - ETA: 275s - loss: 4.8712 - acc: 0.0104 - ETA: 272s - loss: 4.8712 - acc: 0.0104 - ETA: 269s - loss: 4.8711 - acc: 0.0104 - ETA: 266s - loss: 4.8710 - acc: 0.0103 - ETA: 263s - loss: 4.8709 - acc: 0.0105 - ETA: 259s - loss: 4.8706 - acc: 0.0104 - ETA: 256s - loss: 4.8710 - acc: 0.0104 - ETA: 253s - loss: 4.8715 - acc: 0.0104 - ETA: 250s - loss: 4.8711 - acc: 0.0105 - ETA: 247s - loss: 4.8711 - acc: 0.0107 - ETA: 243s - loss: 4.8711 - acc: 0.0106 - ETA: 240s - loss: 4.8712 - acc: 0.0106 - ETA: 237s - loss: 4.8713 - acc: 0.0105 - ETA: 234s - loss: 4.8713 - acc: 0.0105 - ETA: 231s - loss: 4.8712 - acc: 0.0105 - ETA: 229s - loss: 4.8711 - acc: 0.0106 - ETA: 225s - loss: 4.8712 - acc: 0.0106 - ETA: 222s - loss: 4.8711 - acc: 0.0105 - ETA: 222s - loss: 4.8710 - acc: 0.0105 - ETA: 219s - loss: 4.8705 - acc: 0.0108 - ETA: 215s - loss: 4.8706 - acc: 0.0108 - ETA: 212s - loss: 4.8707 - acc: 0.0107 - ETA: 208s - loss: 4.8710 - acc: 0.0107 - ETA: 204s - loss: 4.8705 - acc: 0.0108 - ETA: 201s - loss: 4.8706 - acc: 0.0108 - ETA: 198s - loss: 4.8710 - acc: 0.0109 - ETA: 194s - loss: 4.8710 - acc: 0.0109 - ETA: 190s - loss: 4.8712 - acc: 0.0109 - ETA: 187s - loss: 4.8711 - acc: 0.0108 - ETA: 183s - loss: 4.8710 - acc: 0.0108 - ETA: 180s - loss: 4.8709 - acc: 0.0108 - ETA: 176s - loss: 4.8709 - acc: 0.0107 - ETA: 173s - loss: 4.8707 - acc: 0.0107 - ETA: 170s - loss: 4.8709 - acc: 0.0106 - ETA: 166s - loss: 4.8710 - acc: 0.0106 - ETA: 163s - loss: 4.8711 - acc: 0.0106 - ETA: 160s - loss: 4.8709 - acc: 0.0105 - ETA: 156s - loss: 4.8709 - acc: 0.0105 - ETA: 153s - loss: 4.8707 - acc: 0.0106 - ETA: 149s - loss: 4.8706 - acc: 0.0106 - ETA: 146s - loss: 4.8704 - acc: 0.0106 - ETA: 142s - loss: 4.8702 - acc: 0.0105 - ETA: 139s - loss: 4.8699 - acc: 0.0105 - ETA: 135s - loss: 4.8697 - acc: 0.0104 - ETA: 132s - loss: 4.8698 - acc: 0.0104 - ETA: 129s - loss: 4.8697 - acc: 0.0105 - ETA: 125s - loss: 4.8693 - acc: 0.0105 - ETA: 122s - loss: 4.8691 - acc: 0.0105 - ETA: 119s - loss: 4.8693 - acc: 0.0104 - ETA: 115s - loss: 4.8696 - acc: 0.0104 - ETA: 112s - loss: 4.8697 - acc: 0.0105 - ETA: 109s - loss: 4.8697 - acc: 0.0105 - ETA: 105s - loss: 4.8698 - acc: 0.0105 - ETA: 102s - loss: 4.8697 - acc: 0.0106 - ETA: 99s - loss: 4.8697 - acc: 0.0106  - ETA: 95s - loss: 4.8697 - acc: 0.0105 - ETA: 92s - loss: 4.8694 - acc: 0.0105 - ETA: 89s - loss: 4.8694 - acc: 0.0105 - ETA: 85s - loss: 4.8693 - acc: 0.0104 - ETA: 82s - loss: 4.8694 - acc: 0.0104 - ETA: 79s - loss: 4.8696 - acc: 0.0104 - ETA: 76s - loss: 4.8692 - acc: 0.0103 - ETA: 72s - loss: 4.8691 - acc: 0.0103 - ETA: 69s - loss: 4.8688 - acc: 0.0103 - ETA: 66s - loss: 4.8691 - acc: 0.0102 - ETA: 63s - loss: 4.8688 - acc: 0.0102 - ETA: 60s - loss: 4.8692 - acc: 0.0102 - ETA: 56s - loss: 4.8690 - acc: 0.0103 - ETA: 53s - loss: 4.8687 - acc: 0.0103 - ETA: 50s - loss: 4.8687 - acc: 0.0102 - ETA: 47s - loss: 4.8686 - acc: 0.0102 - ETA: 44s - loss: 4.8686 - acc: 0.0102 - ETA: 40s - loss: 4.8684 - acc: 0.0103 - ETA: 37s - loss: 4.8682 - acc: 0.0104 - ETA: 34s - loss: 4.8678 - acc: 0.0104 - ETA: 31s - loss: 4.8677 - acc: 0.0103 - ETA: 28s - loss: 4.8676 - acc: 0.0103 - ETA: 25s - loss: 4.8674 - acc: 0.0103 - ETA: 22s - loss: 4.8677 - acc: 0.0104 - ETA: 19s - loss: 4.8674 - acc: 0.0105 - ETA: 15s - loss: 4.8674 - acc: 0.0105 - ETA: 12s - loss: 4.8671 - acc: 0.0106 - ETA: 9s - loss: 4.8670 - acc: 0.0106  - ETA: 6s - loss: 4.8666 - acc: 0.0107 - ETA: 3s - loss: 4.8664 - acc: 0.0107Epoch 00001: val_loss improved from 4.86677 to 4.84676, saving model to saved_models/weights.best.from_scratch.hdf5
6680/6680 [==============================] - 1174s - loss: 4.8666 - acc: 0.0106 - val_loss: 4.8468 - val_acc: 0.0168
Epoch 3/5
6660/6680 [============================>.] - ETA: 1212s - loss: 4.8057 - acc: 0.0000e+00 - ETA: 1274s - loss: 4.8744 - acc: 0.0000e+00 - ETA: 1218s - loss: 4.8574 - acc: 0.0000e+00 - ETA: 1111s - loss: 4.8526 - acc: 0.0125     - ETA: 1009s - loss: 4.8484 - acc: 0.0100 - ETA: 995s - loss: 4.8305 - acc: 0.0167  - ETA: 1170s - loss: 4.8450 - acc: 0.0143 - ETA: 1145s - loss: 4.8350 - acc: 0.0125 - ETA: 1122s - loss: 4.8291 - acc: 0.0111 - ETA: 1084s - loss: 4.8184 - acc: 0.0150 - ETA: 1038s - loss: 4.8194 - acc: 0.0136 - ETA: 1006s - loss: 4.8069 - acc: 0.0125 - ETA: 967s - loss: 4.8138 - acc: 0.0115  - ETA: 932s - loss: 4.8208 - acc: 0.0107 - ETA: 902s - loss: 4.8246 - acc: 0.0100 - ETA: 878s - loss: 4.8243 - acc: 0.0094 - ETA: 850s - loss: 4.8364 - acc: 0.0088 - ETA: 826s - loss: 4.8443 - acc: 0.0083 - ETA: 810s - loss: 4.8428 - acc: 0.0079 - ETA: 790s - loss: 4.8396 - acc: 0.0075 - ETA: 776s - loss: 4.8396 - acc: 0.0071 - ETA: 763s - loss: 4.8371 - acc: 0.0068 - ETA: 748s - loss: 4.8390 - acc: 0.0087 - ETA: 737s - loss: 4.8399 - acc: 0.0083 - ETA: 745s - loss: 4.8418 - acc: 0.0080 - ETA: 763s - loss: 4.8453 - acc: 0.0077 - ETA: 761s - loss: 4.8420 - acc: 0.0093 - ETA: 746s - loss: 4.8410 - acc: 0.0107 - ETA: 746s - loss: 4.8435 - acc: 0.0138 - ETA: 757s - loss: 4.8450 - acc: 0.0133 - ETA: 756s - loss: 4.8470 - acc: 0.0145 - ETA: 753s - loss: 4.8449 - acc: 0.0141 - ETA: 747s - loss: 4.8457 - acc: 0.0136 - ETA: 737s - loss: 4.8462 - acc: 0.0132 - ETA: 730s - loss: 4.8420 - acc: 0.0157 - ETA: 722s - loss: 4.8429 - acc: 0.0153 - ETA: 715s - loss: 4.8447 - acc: 0.0149 - ETA: 713s - loss: 4.8423 - acc: 0.0145 - ETA: 717s - loss: 4.8423 - acc: 0.0141 - ETA: 719s - loss: 4.8400 - acc: 0.0138 - ETA: 718s - loss: 4.8417 - acc: 0.0134 - ETA: 726s - loss: 4.8414 - acc: 0.0131 - ETA: 738s - loss: 4.8424 - acc: 0.0128 - ETA: 746s - loss: 4.8417 - acc: 0.0136 - ETA: 763s - loss: 4.8437 - acc: 0.0133 - ETA: 777s - loss: 4.8422 - acc: 0.0152 - ETA: 775s - loss: 4.8423 - acc: 0.0160 - ETA: 777s - loss: 4.8413 - acc: 0.0177 - ETA: 776s - loss: 4.8417 - acc: 0.0173 - ETA: 772s - loss: 4.8422 - acc: 0.0180 - ETA: 768s - loss: 4.8437 - acc: 0.0176 - ETA: 767s - loss: 4.8435 - acc: 0.0173 - ETA: 768s - loss: 4.8439 - acc: 0.0170 - ETA: 768s - loss: 4.8427 - acc: 0.0176 - ETA: 773s - loss: 4.8410 - acc: 0.0182 - ETA: 780s - loss: 4.8424 - acc: 0.0179 - ETA: 788s - loss: 4.8422 - acc: 0.0175 - ETA: 802s - loss: 4.8433 - acc: 0.0172 - ETA: 809s - loss: 4.8456 - acc: 0.0169 - ETA: 853s - loss: 4.8456 - acc: 0.0167 - ETA: 848s - loss: 4.8470 - acc: 0.0164 - ETA: 841s - loss: 4.8471 - acc: 0.0161 - ETA: 843s - loss: 4.8465 - acc: 0.0159 - ETA: 839s - loss: 4.8465 - acc: 0.0164 - ETA: 838s - loss: 4.8455 - acc: 0.0162 - ETA: 832s - loss: 4.8434 - acc: 0.0159 - ETA: 830s - loss: 4.8417 - acc: 0.0164 - ETA: 831s - loss: 4.8408 - acc: 0.0162 - ETA: 830s - loss: 4.8401 - acc: 0.0167 - ETA: 848s - loss: 4.8388 - acc: 0.0171 - ETA: 860s - loss: 4.8378 - acc: 0.0169 - ETA: 866s - loss: 4.8397 - acc: 0.0167 - ETA: 871s - loss: 4.8394 - acc: 0.0164 - ETA: 875s - loss: 4.8381 - acc: 0.0169 - ETA: 879s - loss: 4.8377 - acc: 0.0167 - ETA: 880s - loss: 4.8369 - acc: 0.0164 - ETA: 886s - loss: 4.8370 - acc: 0.0162 - ETA: 900s - loss: 4.8357 - acc: 0.0160 - ETA: 907s - loss: 4.8367 - acc: 0.0158 - ETA: 908s - loss: 4.8365 - acc: 0.0156 - ETA: 901s - loss: 4.8379 - acc: 0.0154 - ETA: 894s - loss: 4.8383 - acc: 0.0152 - ETA: 885s - loss: 4.8382 - acc: 0.0157 - ETA: 877s - loss: 4.8391 - acc: 0.0155 - ETA: 869s - loss: 4.8395 - acc: 0.0153 - ETA: 861s - loss: 4.8404 - acc: 0.0151 - ETA: 853s - loss: 4.8395 - acc: 0.0155 - ETA: 850s - loss: 4.8395 - acc: 0.0159 - ETA: 844s - loss: 4.8382 - acc: 0.0157 - ETA: 838s - loss: 4.8386 - acc: 0.0156 - ETA: 830s - loss: 4.8390 - acc: 0.0154 - ETA: 823s - loss: 4.8383 - acc: 0.0152 - ETA: 815s - loss: 4.8390 - acc: 0.0151 - ETA: 808s - loss: 4.8387 - acc: 0.0149 - ETA: 803s - loss: 4.8377 - acc: 0.0158 - ETA: 795s - loss: 4.8371 - acc: 0.0161 - ETA: 788s - loss: 4.8371 - acc: 0.0160 - ETA: 783s - loss: 4.8373 - acc: 0.0158 - ETA: 777s - loss: 4.8379 - acc: 0.0157 - ETA: 777s - loss: 4.8369 - acc: 0.0155 - ETA: 772s - loss: 4.8360 - acc: 0.0158 - ETA: 766s - loss: 4.8353 - acc: 0.0157 - ETA: 764s - loss: 4.8356 - acc: 0.0160 - ETA: 760s - loss: 4.8342 - acc: 0.0159 - ETA: 757s - loss: 4.8336 - acc: 0.0157 - ETA: 751s - loss: 4.8329 - acc: 0.0156 - ETA: 747s - loss: 4.8333 - acc: 0.0154 - ETA: 743s - loss: 4.8329 - acc: 0.0153 - ETA: 750s - loss: 4.8328 - acc: 0.0151 - ETA: 746s - loss: 4.8323 - acc: 0.0150 - ETA: 744s - loss: 4.8322 - acc: 0.0149 - ETA: 751s - loss: 4.8311 - acc: 0.0147 - ETA: 745s - loss: 4.8307 - acc: 0.0155 - ETA: 739s - loss: 4.8304 - acc: 0.0158 - ETA: 734s - loss: 4.8302 - acc: 0.0157 - ETA: 729s - loss: 4.8289 - acc: 0.0155 - ETA: 723s - loss: 4.8279 - acc: 0.0158 - ETA: 719s - loss: 4.8263 - acc: 0.0169 - ETA: 713s - loss: 4.8266 - acc: 0.0172 - ETA: 710s - loss: 4.8269 - acc: 0.0171 - ETA: 705s - loss: 4.8274 - acc: 0.0169 - ETA: 700s - loss: 4.8267 - acc: 0.0168 - ETA: 695s - loss: 4.8263 - acc: 0.0171 - ETA: 690s - loss: 4.8269 - acc: 0.0169 - ETA: 686s - loss: 4.8263 - acc: 0.0172 - ETA: 681s - loss: 4.8235 - acc: 0.0179 - ETA: 676s - loss: 4.8237 - acc: 0.0177 - ETA: 672s - loss: 4.8238 - acc: 0.0176 - ETA: 668s - loss: 4.8236 - acc: 0.0174 - ETA: 662s - loss: 4.8240 - acc: 0.0173 - ETA: 663s - loss: 4.8231 - acc: 0.0172 - ETA: 659s - loss: 4.8241 - acc: 0.0170 - ETA: 654s - loss: 4.8243 - acc: 0.0169 - ETA: 649s - loss: 4.8248 - acc: 0.0168 - ETA: 644s - loss: 4.8255 - acc: 0.0167 - ETA: 639s - loss: 4.8258 - acc: 0.0165 - ETA: 634s - loss: 4.8246 - acc: 0.0164 - ETA: 631s - loss: 4.8250 - acc: 0.0163 - ETA: 630s - loss: 4.8241 - acc: 0.0162 - ETA: 627s - loss: 4.8234 - acc: 0.0164 - ETA: 623s - loss: 4.8236 - acc: 0.0163 - ETA: 619s - loss: 4.8241 - acc: 0.0165 - ETA: 615s - loss: 4.8252 - acc: 0.0164 - ETA: 610s - loss: 4.8254 - acc: 0.0163 - ETA: 605s - loss: 4.8261 - acc: 0.0166 - ETA: 601s - loss: 4.8255 - acc: 0.0164 - ETA: 598s - loss: 4.8253 - acc: 0.0167 - ETA: 596s - loss: 4.8256 - acc: 0.0169 - ETA: 592s - loss: 4.8251 - acc: 0.0168 - ETA: 587s - loss: 4.8247 - acc: 0.0167 - ETA: 582s - loss: 4.8242 - acc: 0.0172 - ETA: 578s - loss: 4.8248 - acc: 0.0171 - ETA: 573s - loss: 4.8242 - acc: 0.0170 - ETA: 568s - loss: 4.8244 - acc: 0.0169 - ETA: 564s - loss: 4.8250 - acc: 0.0168 - ETA: 559s - loss: 4.8245 - acc: 0.0173 - ETA: 555s - loss: 4.8245 - acc: 0.0172 - ETA: 550s - loss: 4.8248 - acc: 0.0171 - ETA: 546s - loss: 4.8245 - acc: 0.0170 - ETA: 541s - loss: 4.8234 - acc: 0.0172 - ETA: 538s - loss: 4.8228 - acc: 0.0171 - ETA: 534s - loss: 4.8218 - acc: 0.0173 - ETA: 530s - loss: 4.8218 - acc: 0.0172 - ETA: 526s - loss: 4.8221 - acc: 0.0171 - ETA: 524s - loss: 4.8218 - acc: 0.0170 - ETA: 521s - loss: 4.8215 - acc: 0.0169 - ETA: 517s - loss: 4.8226 - acc: 0.0171 - ETA: 515s - loss: 4.8227 - acc: 0.0170 - ETA: 512s - loss: 4.8221 - acc: 0.0172 - ETA: 510s - loss: 4.8216 - acc: 0.0174 - ETA: 507s - loss: 4.8214 - acc: 0.0173 - ETA: 504s - loss: 4.8218 - acc: 0.0172 - ETA: 501s - loss: 4.8223 - acc: 0.0171 - ETA: 499s - loss: 4.8218 - acc: 0.0172 - ETA: 497s - loss: 4.8220 - acc: 0.0174 - ETA: 495s - loss: 4.8221 - acc: 0.0173 - ETA: 493s - loss: 4.8215 - acc: 0.0175 - ETA: 491s - loss: 4.8214 - acc: 0.0180 - ETA: 490s - loss: 4.8223 - acc: 0.0179 - ETA: 489s - loss: 4.8225 - acc: 0.0181 - ETA: 486s - loss: 4.8224 - acc: 0.0180 - ETA: 484s - loss: 4.8221 - acc: 0.0179 - ETA: 481s - loss: 4.8215 - acc: 0.0180 - ETA: 479s - loss: 4.8216 - acc: 0.0179 - ETA: 475s - loss: 4.8221 - acc: 0.0181 - ETA: 471s - loss: 4.8219 - acc: 0.0180 - ETA: 467s - loss: 4.8214 - acc: 0.0179 - ETA: 463s - loss: 4.8213 - acc: 0.0178 - ETA: 465s - loss: 4.8215 - acc: 0.0180 - ETA: 466s - loss: 4.8220 - acc: 0.0179 - ETA: 462s - loss: 4.8219 - acc: 0.0178 - ETA: 457s - loss: 4.8224 - acc: 0.0177 - ETA: 453s - loss: 4.8226 - acc: 0.0176 - ETA: 449s - loss: 4.8224 - acc: 0.0178 - ETA: 445s - loss: 4.8223 - acc: 0.0177 - ETA: 440s - loss: 4.8220 - acc: 0.0179 - ETA: 436s - loss: 4.8219 - acc: 0.0180 - ETA: 433s - loss: 4.8221 - acc: 0.0179 - ETA: 429s - loss: 4.8217 - acc: 0.0178 - ETA: 425s - loss: 4.8216 - acc: 0.0178 - ETA: 421s - loss: 4.8216 - acc: 0.0177 - ETA: 418s - loss: 4.8216 - acc: 0.0176 - ETA: 414s - loss: 4.8217 - acc: 0.0175 - ETA: 411s - loss: 4.8214 - acc: 0.0174 - ETA: 408s - loss: 4.8219 - acc: 0.0173 - ETA: 404s - loss: 4.8213 - acc: 0.0175 - ETA: 400s - loss: 4.8210 - acc: 0.0176 - ETA: 396s - loss: 4.8211 - acc: 0.0178 - ETA: 392s - loss: 4.8212 - acc: 0.0177 - ETA: 388s - loss: 4.8217 - acc: 0.0176 - ETA: 385s - loss: 4.8207 - acc: 0.0180 - ETA: 381s - loss: 4.8203 - acc: 0.0182 - ETA: 377s - loss: 4.8203 - acc: 0.0181 - ETA: 375s - loss: 4.8207 - acc: 0.0180 - ETA: 371s - loss: 4.8206 - acc: 0.0179 - ETA: 367s - loss: 4.8206 - acc: 0.0178 - ETA: 363s - loss: 4.8200 - acc: 0.0177 - ETA: 359s - loss: 4.8194 - acc: 0.0181 - ETA: 355s - loss: 4.8197 - acc: 0.0180 - ETA: 352s - loss: 4.8189 - acc: 0.0182 - ETA: 348s - loss: 4.8187 - acc: 0.0183 - ETA: 344s - loss: 4.8185 - acc: 0.0182 - ETA: 341s - loss: 4.8187 - acc: 0.0182 - ETA: 337s - loss: 4.8188 - acc: 0.0181 - ETA: 334s - loss: 4.8197 - acc: 0.0180 - ETA: 330s - loss: 4.8196 - acc: 0.0179 - ETA: 327s - loss: 4.8192 - acc: 0.0178 - ETA: 324s - loss: 4.8190 - acc: 0.0178 - ETA: 320s - loss: 4.8197 - acc: 0.0177 - ETA: 317s - loss: 4.8201 - acc: 0.0178 - ETA: 313s - loss: 4.8198 - acc: 0.0180 - ETA: 310s - loss: 4.8207 - acc: 0.0179 - ETA: 306s - loss: 4.8201 - acc: 0.0180 - ETA: 303s - loss: 4.8203 - acc: 0.0179 - ETA: 300s - loss: 4.8202 - acc: 0.0181 - ETA: 297s - loss: 4.8202 - acc: 0.0180 - ETA: 294s - loss: 4.8199 - acc: 0.0181 - ETA: 290s - loss: 4.8200 - acc: 0.0181 - ETA: 287s - loss: 4.8200 - acc: 0.0180 - ETA: 284s - loss: 4.8200 - acc: 0.0181 - ETA: 280s - loss: 4.8205 - acc: 0.0183 - ETA: 277s - loss: 4.8205 - acc: 0.0182 - ETA: 274s - loss: 4.8206 - acc: 0.0181 - ETA: 271s - loss: 4.8200 - acc: 0.0180 - ETA: 267s - loss: 4.8194 - acc: 0.0182 - ETA: 265s - loss: 4.8196 - acc: 0.0183 - ETA: 262s - loss: 4.8193 - acc: 0.0182 - ETA: 258s - loss: 4.8192 - acc: 0.0181 - ETA: 256s - loss: 4.8192 - acc: 0.0181 - ETA: 253s - loss: 4.8193 - acc: 0.0180 - ETA: 249s - loss: 4.8186 - acc: 0.0181 - ETA: 246s - loss: 4.8187 - acc: 0.0181 - ETA: 243s - loss: 4.8189 - acc: 0.0180 - ETA: 239s - loss: 4.8187 - acc: 0.0181 - ETA: 237s - loss: 4.8187 - acc: 0.0180 - ETA: 234s - loss: 4.8184 - acc: 0.0182 - ETA: 231s - loss: 4.8188 - acc: 0.0181 - ETA: 228s - loss: 4.8185 - acc: 0.0182 - ETA: 224s - loss: 4.8177 - acc: 0.0181 - ETA: 221s - loss: 4.8176 - acc: 0.0181 - ETA: 218s - loss: 4.8171 - acc: 0.0180 - ETA: 215s - loss: 4.8170 - acc: 0.0179 - ETA: 211s - loss: 4.8161 - acc: 0.0181 - ETA: 208s - loss: 4.8157 - acc: 0.0180 - ETA: 205s - loss: 4.8166 - acc: 0.0179 - ETA: 201s - loss: 4.8161 - acc: 0.0179 - ETA: 198s - loss: 4.8161 - acc: 0.0178 - ETA: 195s - loss: 4.8164 - acc: 0.0177 - ETA: 192s - loss: 4.8160 - acc: 0.0177 - ETA: 189s - loss: 4.8160 - acc: 0.0176 - ETA: 186s - loss: 4.8160 - acc: 0.0175 - ETA: 183s - loss: 4.8158 - acc: 0.0175 - ETA: 180s - loss: 4.8152 - acc: 0.0174 - ETA: 177s - loss: 4.8147 - acc: 0.0173 - ETA: 174s - loss: 4.8141 - acc: 0.0173 - ETA: 171s - loss: 4.8136 - acc: 0.0174 - ETA: 168s - loss: 4.8130 - acc: 0.0175 - ETA: 165s - loss: 4.8134 - acc: 0.0174 - ETA: 162s - loss: 4.8127 - acc: 0.0174 - ETA: 159s - loss: 4.8129 - acc: 0.0173 - ETA: 156s - loss: 4.8119 - acc: 0.0174 - ETA: 154s - loss: 4.8124 - acc: 0.0174 - ETA: 151s - loss: 4.8119 - acc: 0.0173 - ETA: 148s - loss: 4.8127 - acc: 0.0174 - ETA: 145s - loss: 4.8123 - acc: 0.0174 - ETA: 142s - loss: 4.8124 - acc: 0.0173 - ETA: 139s - loss: 4.8122 - acc: 0.0172 - ETA: 137s - loss: 4.8121 - acc: 0.0172 - ETA: 133s - loss: 4.8118 - acc: 0.0171 - ETA: 130s - loss: 4.8115 - acc: 0.0171 - ETA: 127s - loss: 4.8114 - acc: 0.0170 - ETA: 124s - loss: 4.8114 - acc: 0.0170 - ETA: 121s - loss: 4.8112 - acc: 0.0169 - ETA: 118s - loss: 4.8112 - acc: 0.0168 - ETA: 115s - loss: 4.8118 - acc: 0.0168 - ETA: 113s - loss: 4.8115 - acc: 0.0167 - ETA: 110s - loss: 4.8112 - acc: 0.0167 - ETA: 107s - loss: 4.8110 - acc: 0.0166 - ETA: 104s - loss: 4.8111 - acc: 0.0166 - ETA: 101s - loss: 4.8108 - acc: 0.0165 - ETA: 98s - loss: 4.8117 - acc: 0.0164  - ETA: 95s - loss: 4.8122 - acc: 0.0166 - ETA: 92s - loss: 4.8116 - acc: 0.0165 - ETA: 89s - loss: 4.8114 - acc: 0.0164 - ETA: 86s - loss: 4.8115 - acc: 0.0164 - ETA: 83s - loss: 4.8115 - acc: 0.0163 - ETA: 81s - loss: 4.8118 - acc: 0.0163 - ETA: 78s - loss: 4.8126 - acc: 0.0162 - ETA: 75s - loss: 4.8122 - acc: 0.0162 - ETA: 72s - loss: 4.8124 - acc: 0.0163 - ETA: 69s - loss: 4.8125 - acc: 0.0162 - ETA: 66s - loss: 4.8127 - acc: 0.0162 - ETA: 63s - loss: 4.8131 - acc: 0.0163 - ETA: 60s - loss: 4.8130 - acc: 0.0162 - ETA: 57s - loss: 4.8131 - acc: 0.0162 - ETA: 54s - loss: 4.8133 - acc: 0.0161 - ETA: 51s - loss: 4.8133 - acc: 0.0161 - ETA: 48s - loss: 4.8132 - acc: 0.0162 - ETA: 45s - loss: 4.8133 - acc: 0.0161 - ETA: 42s - loss: 4.8134 - acc: 0.0161 - ETA: 39s - loss: 4.8133 - acc: 0.0160 - ETA: 36s - loss: 4.8133 - acc: 0.0160 - ETA: 33s - loss: 4.8132 - acc: 0.0161 - ETA: 30s - loss: 4.8133 - acc: 0.0160 - ETA: 26s - loss: 4.8128 - acc: 0.0163 - ETA: 23s - loss: 4.8130 - acc: 0.0163 - ETA: 20s - loss: 4.8133 - acc: 0.0162 - ETA: 17s - loss: 4.8134 - acc: 0.0162 - ETA: 14s - loss: 4.8133 - acc: 0.0161 - ETA: 11s - loss: 4.8131 - acc: 0.0161 - ETA: 8s - loss: 4.8131 - acc: 0.0162  - ETA: 5s - loss: 4.8128 - acc: 0.0161 - ETA: 2s - loss: 4.8132 - acc: 0.0161Epoch 00002: val_loss improved from 4.84676 to 4.80048, saving model to saved_models/weights.best.from_scratch.hdf5
6680/6680 [==============================] - 1070s - loss: 4.8128 - acc: 0.0162 - val_loss: 4.8005 - val_acc: 0.0168
Epoch 4/5
6660/6680 [============================>.] - ETA: 642s - loss: 4.8436 - acc: 0.0000e+00 - ETA: 813s - loss: 4.9019 - acc: 0.0000e+00 - ETA: 966s - loss: 4.8810 - acc: 0.0000e+00 - ETA: 948s - loss: 4.8483 - acc: 0.0000e+00 - ETA: 1281s - loss: 4.8268 - acc: 0.0000e+00 - ETA: 1184s - loss: 4.8239 - acc: 0.0000e+00 - ETA: 1075s - loss: 4.8265 - acc: 0.0000e+00 - ETA: 995s - loss: 4.8041 - acc: 0.0063      - ETA: 938s - loss: 4.7872 - acc: 0.0111 - ETA: 881s - loss: 4.7769 - acc: 0.0150 - ETA: 839s - loss: 4.7754 - acc: 0.0182 - ETA: 817s - loss: 4.7838 - acc: 0.0167 - ETA: 799s - loss: 4.7765 - acc: 0.0154 - ETA: 781s - loss: 4.7671 - acc: 0.0179 - ETA: 765s - loss: 4.7679 - acc: 0.0167 - ETA: 766s - loss: 4.7621 - acc: 0.0156 - ETA: 775s - loss: 4.7641 - acc: 0.0147 - ETA: 772s - loss: 4.7649 - acc: 0.0139 - ETA: 766s - loss: 4.7703 - acc: 0.0158 - ETA: 764s - loss: 4.7682 - acc: 0.0150 - ETA: 767s - loss: 4.7736 - acc: 0.0143 - ETA: 769s - loss: 4.7711 - acc: 0.0136 - ETA: 770s - loss: 4.7728 - acc: 0.0130 - ETA: 772s - loss: 4.7711 - acc: 0.0125 - ETA: 768s - loss: 4.7684 - acc: 0.0140 - ETA: 763s - loss: 4.7653 - acc: 0.0135 - ETA: 761s - loss: 4.7626 - acc: 0.0130 - ETA: 750s - loss: 4.7606 - acc: 0.0143 - ETA: 746s - loss: 4.7675 - acc: 0.0138 - ETA: 745s - loss: 4.7679 - acc: 0.0133 - ETA: 743s - loss: 4.7616 - acc: 0.0145 - ETA: 742s - loss: 4.7620 - acc: 0.0141 - ETA: 747s - loss: 4.7652 - acc: 0.0136 - ETA: 747s - loss: 4.7678 - acc: 0.0132 - ETA: 747s - loss: 4.7722 - acc: 0.0129 - ETA: 742s - loss: 4.7705 - acc: 0.0125 - ETA: 740s - loss: 4.7680 - acc: 0.0122 - ETA: 733s - loss: 4.7652 - acc: 0.0118 - ETA: 733s - loss: 4.7636 - acc: 0.0128 - ETA: 736s - loss: 4.7639 - acc: 0.0125 - ETA: 734s - loss: 4.7641 - acc: 0.0134 - ETA: 734s - loss: 4.7610 - acc: 0.0131 - ETA: 745s - loss: 4.7580 - acc: 0.0140 - ETA: 741s - loss: 4.7575 - acc: 0.0148 - ETA: 744s - loss: 4.7544 - acc: 0.0144 - ETA: 748s - loss: 4.7581 - acc: 0.0141 - ETA: 753s - loss: 4.7586 - acc: 0.0138 - ETA: 752s - loss: 4.7582 - acc: 0.0135 - ETA: 753s - loss: 4.7589 - acc: 0.0133 - ETA: 750s - loss: 4.7545 - acc: 0.0150 - ETA: 758s - loss: 4.7555 - acc: 0.0157 - ETA: 777s - loss: 4.7525 - acc: 0.0173 - ETA: 835s - loss: 4.7511 - acc: 0.0170 - ETA: 849s - loss: 4.7450 - acc: 0.0167 - ETA: 848s - loss: 4.7471 - acc: 0.0173 - ETA: 846s - loss: 4.7487 - acc: 0.0170 - ETA: 850s - loss: 4.7539 - acc: 0.0167 - ETA: 850s - loss: 4.7589 - acc: 0.0164 - ETA: 851s - loss: 4.7574 - acc: 0.0161 - ETA: 854s - loss: 4.7614 - acc: 0.0158 - ETA: 856s - loss: 4.7623 - acc: 0.0172 - ETA: 853s - loss: 4.7615 - acc: 0.0169 - ETA: 845s - loss: 4.7593 - acc: 0.0167 - ETA: 848s - loss: 4.7583 - acc: 0.0172 - ETA: 849s - loss: 4.7579 - acc: 0.0169 - ETA: 847s - loss: 4.7560 - acc: 0.0167 - ETA: 840s - loss: 4.7571 - acc: 0.0164 - ETA: 831s - loss: 4.7572 - acc: 0.0162 - ETA: 822s - loss: 4.7562 - acc: 0.0159 - ETA: 815s - loss: 4.7575 - acc: 0.0164 - ETA: 808s - loss: 4.7614 - acc: 0.0162 - ETA: 799s - loss: 4.7618 - acc: 0.0160 - ETA: 792s - loss: 4.7640 - acc: 0.0158 - ETA: 785s - loss: 4.7619 - acc: 0.0162 - ETA: 777s - loss: 4.7597 - acc: 0.0167 - ETA: 770s - loss: 4.7556 - acc: 0.0171 - ETA: 763s - loss: 4.7556 - acc: 0.0175 - ETA: 755s - loss: 4.7546 - acc: 0.0179 - ETA: 748s - loss: 4.7550 - acc: 0.0177 - ETA: 746s - loss: 4.7535 - acc: 0.0175 - ETA: 739s - loss: 4.7557 - acc: 0.0173 - ETA: 732s - loss: 4.7550 - acc: 0.0177 - ETA: 726s - loss: 4.7555 - acc: 0.0181 - ETA: 719s - loss: 4.7552 - acc: 0.0190 - ETA: 713s - loss: 4.7588 - acc: 0.0188 - ETA: 707s - loss: 4.7588 - acc: 0.0186 - ETA: 701s - loss: 4.7600 - acc: 0.0184 - ETA: 695s - loss: 4.7574 - acc: 0.0188 - ETA: 689s - loss: 4.7583 - acc: 0.0185 - ETA: 683s - loss: 4.7585 - acc: 0.0183 - ETA: 682s - loss: 4.7565 - acc: 0.0181 - ETA: 679s - loss: 4.7555 - acc: 0.0179 - ETA: 679s - loss: 4.7580 - acc: 0.0183 - ETA: 678s - loss: 4.7574 - acc: 0.0181 - ETA: 674s - loss: 4.7579 - acc: 0.0179 - ETA: 672s - loss: 4.7589 - acc: 0.0177 - ETA: 668s - loss: 4.7583 - acc: 0.0180 - ETA: 666s - loss: 4.7592 - acc: 0.0179 - ETA: 663s - loss: 4.7583 - acc: 0.0177 - ETA: 661s - loss: 4.7586 - acc: 0.0175 - ETA: 658s - loss: 4.7598 - acc: 0.0173 - ETA: 659s - loss: 4.7607 - acc: 0.0176 - ETA: 660s - loss: 4.7604 - acc: 0.0175 - ETA: 667s - loss: 4.7602 - acc: 0.0178 - ETA: 665s - loss: 4.7582 - acc: 0.0176 - ETA: 662s - loss: 4.7596 - acc: 0.0175 - ETA: 662s - loss: 4.7592 - acc: 0.0173 - ETA: 658s - loss: 4.7586 - acc: 0.0171 - ETA: 653s - loss: 4.7599 - acc: 0.0170 - ETA: 647s - loss: 4.7594 - acc: 0.0168 - ETA: 642s - loss: 4.7600 - acc: 0.0167 - ETA: 637s - loss: 4.7613 - acc: 0.0170 - ETA: 632s - loss: 4.7617 - acc: 0.0173 - ETA: 628s - loss: 4.7633 - acc: 0.0171 - ETA: 623s - loss: 4.7641 - acc: 0.0170 - ETA: 618s - loss: 4.7637 - acc: 0.0172 - ETA: 613s - loss: 4.7640 - acc: 0.0171 - ETA: 609s - loss: 4.7638 - acc: 0.0174 - ETA: 605s - loss: 4.7644 - acc: 0.0172 - ETA: 600s - loss: 4.7646 - acc: 0.0171 - ETA: 598s - loss: 4.7649 - acc: 0.0169 - ETA: 594s - loss: 4.7647 - acc: 0.0168 - ETA: 589s - loss: 4.7642 - acc: 0.0167 - ETA: 588s - loss: 4.7649 - acc: 0.0165 - ETA: 586s - loss: 4.7646 - acc: 0.0164 - ETA: 584s - loss: 4.7646 - acc: 0.0163 - ETA: 583s - loss: 4.7647 - acc: 0.0161 - ETA: 581s - loss: 4.7638 - acc: 0.0164 - ETA: 579s - loss: 4.7641 - acc: 0.0167 - ETA: 577s - loss: 4.7641 - acc: 0.0169 - ETA: 574s - loss: 4.7643 - acc: 0.0172 - ETA: 572s - loss: 4.7640 - acc: 0.0174 - ETA: 569s - loss: 4.7646 - acc: 0.0173 - ETA: 567s - loss: 4.7646 - acc: 0.0179 - ETA: 564s - loss: 4.7652 - acc: 0.0178 - ETA: 561s - loss: 4.7665 - acc: 0.0176 - ETA: 559s - loss: 4.7663 - acc: 0.0175 - ETA: 557s - loss: 4.7653 - acc: 0.0174 - ETA: 553s - loss: 4.7647 - acc: 0.0176 - ETA: 550s - loss: 4.7666 - acc: 0.0175 - ETA: 546s - loss: 4.7660 - acc: 0.0174 - ETA: 541s - loss: 4.7660 - acc: 0.0173 - ETA: 538s - loss: 4.7665 - acc: 0.0171 - ETA: 534s - loss: 4.7665 - acc: 0.0170 - ETA: 533s - loss: 4.7668 - acc: 0.0172 - ETA: 531s - loss: 4.7670 - acc: 0.0171 - ETA: 528s - loss: 4.7682 - acc: 0.0170 - ETA: 524s - loss: 4.7681 - acc: 0.0169 - ETA: 525s - loss: 4.7680 - acc: 0.0171 - ETA: 532s - loss: 4.7681 - acc: 0.0173 - ETA: 528s - loss: 4.7677 - acc: 0.0175 - ETA: 524s - loss: 4.7680 - acc: 0.0174 - ETA: 520s - loss: 4.7680 - acc: 0.0176 - ETA: 516s - loss: 4.7685 - acc: 0.0175 - ETA: 512s - loss: 4.7682 - acc: 0.0177 - ETA: 507s - loss: 4.7699 - acc: 0.0176 - ETA: 504s - loss: 4.7708 - acc: 0.0175 - ETA: 500s - loss: 4.7709 - acc: 0.0174 - ETA: 496s - loss: 4.7709 - acc: 0.0173 - ETA: 492s - loss: 4.7719 - acc: 0.0172 - ETA: 488s - loss: 4.7717 - acc: 0.0174 - ETA: 484s - loss: 4.7719 - acc: 0.0176 - ETA: 481s - loss: 4.7718 - acc: 0.0178 - ETA: 479s - loss: 4.7720 - acc: 0.0177 - ETA: 476s - loss: 4.7723 - acc: 0.0179 - ETA: 473s - loss: 4.7727 - acc: 0.0178 - ETA: 470s - loss: 4.7720 - acc: 0.0177 - ETA: 468s - loss: 4.7715 - acc: 0.0179 - ETA: 466s - loss: 4.7712 - acc: 0.0180 - ETA: 466s - loss: 4.7711 - acc: 0.0179 - ETA: 464s - loss: 4.7719 - acc: 0.0178 - ETA: 461s - loss: 4.7710 - acc: 0.0177 - ETA: 459s - loss: 4.7705 - acc: 0.0176 - ETA: 455s - loss: 4.7699 - acc: 0.0175 - ETA: 454s - loss: 4.7715 - acc: 0.0174 - ETA: 450s - loss: 4.7719 - acc: 0.0173 - ETA: 446s - loss: 4.7726 - acc: 0.0175 - ETA: 443s - loss: 4.7721 - acc: 0.0177 - ETA: 439s - loss: 4.7718 - acc: 0.0176 - ETA: 436s - loss: 4.7714 - acc: 0.0175 - ETA: 432s - loss: 4.7723 - acc: 0.0174 - ETA: 428s - loss: 4.7720 - acc: 0.0173 - ETA: 424s - loss: 4.7717 - acc: 0.0172 - ETA: 421s - loss: 4.7709 - acc: 0.0182 - ETA: 418s - loss: 4.7709 - acc: 0.0181 - ETA: 414s - loss: 4.7707 - acc: 0.0180 - ETA: 411s - loss: 4.7710 - acc: 0.0179 - ETA: 407s - loss: 4.7706 - acc: 0.0178 - ETA: 404s - loss: 4.7703 - acc: 0.0177 - ETA: 400s - loss: 4.7700 - acc: 0.0176 - ETA: 397s - loss: 4.7705 - acc: 0.0175 - ETA: 394s - loss: 4.7703 - acc: 0.0174 - ETA: 391s - loss: 4.7694 - acc: 0.0174 - ETA: 388s - loss: 4.7688 - acc: 0.0173 - ETA: 384s - loss: 4.7683 - acc: 0.0172 - ETA: 381s - loss: 4.7672 - acc: 0.0173 - ETA: 378s - loss: 4.7680 - acc: 0.0173 - ETA: 376s - loss: 4.7671 - acc: 0.0174 - ETA: 372s - loss: 4.7665 - acc: 0.0176 - ETA: 369s - loss: 4.7667 - acc: 0.0175 - ETA: 366s - loss: 4.7669 - acc: 0.0174 - ETA: 363s - loss: 4.7667 - acc: 0.0173 - ETA: 361s - loss: 4.7660 - acc: 0.0172 - ETA: 358s - loss: 4.7660 - acc: 0.0172 - ETA: 356s - loss: 4.7665 - acc: 0.0171 - ETA: 353s - loss: 4.7659 - acc: 0.0172 - ETA: 351s - loss: 4.7670 - acc: 0.0171 - ETA: 348s - loss: 4.7665 - acc: 0.0173 - ETA: 346s - loss: 4.7661 - acc: 0.0172 - ETA: 346s - loss: 4.7663 - acc: 0.0176 - ETA: 343s - loss: 4.7659 - acc: 0.0178 - ETA: 340s - loss: 4.7659 - acc: 0.0177 - ETA: 336s - loss: 4.7664 - acc: 0.0176 - ETA: 333s - loss: 4.7655 - acc: 0.0175 - ETA: 330s - loss: 4.7654 - acc: 0.0174 - ETA: 327s - loss: 4.7668 - acc: 0.0174 - ETA: 324s - loss: 4.7676 - acc: 0.0173 - ETA: 320s - loss: 4.7676 - acc: 0.0174 - ETA: 317s - loss: 4.7671 - acc: 0.0176 - ETA: 314s - loss: 4.7673 - acc: 0.0175 - ETA: 312s - loss: 4.7674 - acc: 0.0174 - ETA: 309s - loss: 4.7668 - acc: 0.0173 - ETA: 307s - loss: 4.7672 - acc: 0.0173 - ETA: 304s - loss: 4.7674 - acc: 0.0172 - ETA: 301s - loss: 4.7677 - acc: 0.0171 - ETA: 298s - loss: 4.7673 - acc: 0.0170 - ETA: 295s - loss: 4.7677 - acc: 0.0170 - ETA: 292s - loss: 4.7675 - acc: 0.0169 - ETA: 289s - loss: 4.7680 - acc: 0.0170 - ETA: 286s - loss: 4.7676 - acc: 0.0172 - ETA: 283s - loss: 4.7678 - acc: 0.0173 - ETA: 280s - loss: 4.7681 - acc: 0.0172 - ETA: 278s - loss: 4.7683 - acc: 0.0174 - ETA: 275s - loss: 4.7685 - acc: 0.0173 - ETA: 272s - loss: 4.7688 - acc: 0.0172 - ETA: 270s - loss: 4.7691 - acc: 0.0172 - ETA: 267s - loss: 4.7688 - acc: 0.0171 - ETA: 264s - loss: 4.7686 - acc: 0.0170 - ETA: 261s - loss: 4.7687 - acc: 0.0169 - ETA: 258s - loss: 4.7687 - acc: 0.0169 - ETA: 256s - loss: 4.7689 - acc: 0.0168 - ETA: 254s - loss: 4.7685 - acc: 0.0167 - ETA: 252s - loss: 4.7683 - acc: 0.0167 - ETA: 249s - loss: 4.7672 - acc: 0.0168 - ETA: 246s - loss: 4.7671 - acc: 0.0167 - ETA: 243s - loss: 4.7669 - acc: 0.0167 - ETA: 240s - loss: 4.7668 - acc: 0.0166 - ETA: 237s - loss: 4.7667 - acc: 0.0165 - ETA: 234s - loss: 4.7664 - acc: 0.0165 - ETA: 231s - loss: 4.7661 - acc: 0.0164 - ETA: 228s - loss: 4.7661 - acc: 0.0163 - ETA: 225s - loss: 4.7659 - acc: 0.0165 - ETA: 222s - loss: 4.7674 - acc: 0.0164 - ETA: 219s - loss: 4.7678 - acc: 0.0163 - ETA: 217s - loss: 4.7679 - acc: 0.0163 - ETA: 214s - loss: 4.7685 - acc: 0.0162 - ETA: 212s - loss: 4.7682 - acc: 0.0161 - ETA: 210s - loss: 4.7673 - acc: 0.0161 - ETA: 208s - loss: 4.7665 - acc: 0.0160 - ETA: 205s - loss: 4.7664 - acc: 0.0160 - ETA: 202s - loss: 4.7668 - acc: 0.0161 - ETA: 199s - loss: 4.7671 - acc: 0.0162 - ETA: 196s - loss: 4.7674 - acc: 0.0162 - ETA: 193s - loss: 4.7682 - acc: 0.0161 - ETA: 190s - loss: 4.7683 - acc: 0.0160 - ETA: 187s - loss: 4.7680 - acc: 0.0162 - ETA: 184s - loss: 4.7684 - acc: 0.0163 - ETA: 182s - loss: 4.7686 - acc: 0.0162 - ETA: 179s - loss: 4.7680 - acc: 0.0164 - ETA: 176s - loss: 4.7677 - acc: 0.0165 - ETA: 173s - loss: 4.7673 - acc: 0.0164 - ETA: 170s - loss: 4.7675 - acc: 0.0164 - ETA: 167s - loss: 4.7671 - acc: 0.0163 - ETA: 164s - loss: 4.7676 - acc: 0.0162 - ETA: 161s - loss: 4.7675 - acc: 0.0162 - ETA: 159s - loss: 4.7676 - acc: 0.0161 - ETA: 156s - loss: 4.7671 - acc: 0.0161 - ETA: 154s - loss: 4.7670 - acc: 0.0164 - ETA: 151s - loss: 4.7666 - acc: 0.0165 - ETA: 150s - loss: 4.7665 - acc: 0.0164 - ETA: 147s - loss: 4.7661 - acc: 0.0165 - ETA: 144s - loss: 4.7658 - acc: 0.0165 - ETA: 141s - loss: 4.7654 - acc: 0.0166 - ETA: 138s - loss: 4.7660 - acc: 0.0165 - ETA: 135s - loss: 4.7658 - acc: 0.0167 - ETA: 132s - loss: 4.7654 - acc: 0.0170 - ETA: 130s - loss: 4.7657 - acc: 0.0171 - ETA: 127s - loss: 4.7656 - acc: 0.0170 - ETA: 124s - loss: 4.7653 - acc: 0.0170 - ETA: 121s - loss: 4.7657 - acc: 0.0171 - ETA: 118s - loss: 4.7655 - acc: 0.0172 - ETA: 116s - loss: 4.7654 - acc: 0.0171 - ETA: 114s - loss: 4.7657 - acc: 0.0171 - ETA: 111s - loss: 4.7659 - acc: 0.0170 - ETA: 109s - loss: 4.7655 - acc: 0.0169 - ETA: 107s - loss: 4.7648 - acc: 0.0171 - ETA: 104s - loss: 4.7652 - acc: 0.0173 - ETA: 101s - loss: 4.7655 - acc: 0.0173 - ETA: 99s - loss: 4.7653 - acc: 0.0174  - ETA: 96s - loss: 4.7656 - acc: 0.0173 - ETA: 93s - loss: 4.7661 - acc: 0.0174 - ETA: 91s - loss: 4.7662 - acc: 0.0174 - ETA: 88s - loss: 4.7664 - acc: 0.0173 - ETA: 85s - loss: 4.7664 - acc: 0.0173 - ETA: 83s - loss: 4.7659 - acc: 0.0174 - ETA: 80s - loss: 4.7652 - acc: 0.0173 - ETA: 77s - loss: 4.7651 - acc: 0.0173 - ETA: 75s - loss: 4.7650 - acc: 0.0172 - ETA: 72s - loss: 4.7656 - acc: 0.0172 - ETA: 70s - loss: 4.7661 - acc: 0.0171 - ETA: 67s - loss: 4.7667 - acc: 0.0170 - ETA: 64s - loss: 4.7662 - acc: 0.0170 - ETA: 61s - loss: 4.7660 - acc: 0.0169 - ETA: 59s - loss: 4.7658 - acc: 0.0169 - ETA: 56s - loss: 4.7653 - acc: 0.0171 - ETA: 53s - loss: 4.7649 - acc: 0.0174 - ETA: 50s - loss: 4.7651 - acc: 0.0174 - ETA: 47s - loss: 4.7652 - acc: 0.0173 - ETA: 44s - loss: 4.7661 - acc: 0.0172 - ETA: 41s - loss: 4.7660 - acc: 0.0173 - ETA: 38s - loss: 4.7659 - acc: 0.0174 - ETA: 35s - loss: 4.7661 - acc: 0.0174 - ETA: 32s - loss: 4.7664 - acc: 0.0173 - ETA: 29s - loss: 4.7664 - acc: 0.0173 - ETA: 26s - loss: 4.7663 - acc: 0.0174 - ETA: 23s - loss: 4.7665 - acc: 0.0173 - ETA: 20s - loss: 4.7666 - acc: 0.0173 - ETA: 18s - loss: 4.7669 - acc: 0.0174 - ETA: 15s - loss: 4.7675 - acc: 0.0175 - ETA: 12s - loss: 4.7675 - acc: 0.0174 - ETA: 9s - loss: 4.7673 - acc: 0.0175  - ETA: 6s - loss: 4.7674 - acc: 0.0175 - ETA: 3s - loss: 4.7669 - acc: 0.0176Epoch 00003: val_loss improved from 4.80048 to 4.75076, saving model to saved_models/weights.best.from_scratch.hdf5
6680/6680 [==============================] - 1121s - loss: 4.7671 - acc: 0.0175 - val_loss: 4.7508 - val_acc: 0.0204
Epoch 5/5
6660/6680 [============================>.] - ETA: 482s - loss: 4.5581 - acc: 0.0500 - ETA: 484s - loss: 4.6366 - acc: 0.0250 - ETA: 472s - loss: 4.6351 - acc: 0.0167 - ETA: 475s - loss: 4.6333 - acc: 0.0250 - ETA: 474s - loss: 4.6248 - acc: 0.0400 - ETA: 461s - loss: 4.6452 - acc: 0.0333 - ETA: 453s - loss: 4.6466 - acc: 0.0286 - ETA: 497s - loss: 4.6602 - acc: 0.0250 - ETA: 547s - loss: 4.6621 - acc: 0.0333 - ETA: 603s - loss: 4.6805 - acc: 0.0300 - ETA: 602s - loss: 4.6937 - acc: 0.0318 - ETA: 588s - loss: 4.6965 - acc: 0.0292 - ETA: 586s - loss: 4.6909 - acc: 0.0346 - ETA: 583s - loss: 4.6948 - acc: 0.0321 - ETA: 578s - loss: 4.6926 - acc: 0.0300 - ETA: 574s - loss: 4.6979 - acc: 0.0313 - ETA: 565s - loss: 4.6975 - acc: 0.0294 - ETA: 594s - loss: 4.7016 - acc: 0.0278 - ETA: 601s - loss: 4.7132 - acc: 0.0263 - ETA: 595s - loss: 4.7196 - acc: 0.0250 - ETA: 590s - loss: 4.7223 - acc: 0.0238 - ETA: 585s - loss: 4.7286 - acc: 0.0227 - ETA: 581s - loss: 4.7318 - acc: 0.0217 - ETA: 572s - loss: 4.7320 - acc: 0.0208 - ETA: 566s - loss: 4.7312 - acc: 0.0220 - ETA: 558s - loss: 4.7314 - acc: 0.0212 - ETA: 554s - loss: 4.7338 - acc: 0.0222 - ETA: 550s - loss: 4.7352 - acc: 0.0214 - ETA: 547s - loss: 4.7348 - acc: 0.0207 - ETA: 545s - loss: 4.7309 - acc: 0.0200 - ETA: 547s - loss: 4.7454 - acc: 0.0194 - ETA: 545s - loss: 4.7480 - acc: 0.0188 - ETA: 540s - loss: 4.7464 - acc: 0.0212 - ETA: 536s - loss: 4.7399 - acc: 0.0221 - ETA: 531s - loss: 4.7409 - acc: 0.0229 - ETA: 526s - loss: 4.7419 - acc: 0.0222 - ETA: 523s - loss: 4.7422 - acc: 0.0216 - ETA: 527s - loss: 4.7431 - acc: 0.0224 - ETA: 533s - loss: 4.7427 - acc: 0.0231 - ETA: 533s - loss: 4.7390 - acc: 0.0238 - ETA: 527s - loss: 4.7419 - acc: 0.0232 - ETA: 523s - loss: 4.7390 - acc: 0.0238 - ETA: 528s - loss: 4.7327 - acc: 0.0244 - ETA: 531s - loss: 4.7355 - acc: 0.0239 - ETA: 548s - loss: 4.7383 - acc: 0.0244 - ETA: 556s - loss: 4.7349 - acc: 0.0239 - ETA: 552s - loss: 4.7357 - acc: 0.0234 - ETA: 547s - loss: 4.7344 - acc: 0.0240 - ETA: 543s - loss: 4.7359 - acc: 0.0245 - ETA: 540s - loss: 4.7407 - acc: 0.0240 - ETA: 535s - loss: 4.7400 - acc: 0.0235 - ETA: 532s - loss: 4.7379 - acc: 0.0231 - ETA: 528s - loss: 4.7389 - acc: 0.0226 - ETA: 526s - loss: 4.7349 - acc: 0.0222 - ETA: 522s - loss: 4.7341 - acc: 0.0218 - ETA: 518s - loss: 4.7287 - acc: 0.0214 - ETA: 515s - loss: 4.7265 - acc: 0.0211 - ETA: 512s - loss: 4.7321 - acc: 0.0207 - ETA: 511s - loss: 4.7334 - acc: 0.0203 - ETA: 510s - loss: 4.7346 - acc: 0.0200 - ETA: 506s - loss: 4.7368 - acc: 0.0197 - ETA: 502s - loss: 4.7372 - acc: 0.0194 - ETA: 501s - loss: 4.7366 - acc: 0.0198 - ETA: 499s - loss: 4.7355 - acc: 0.0195 - ETA: 496s - loss: 4.7348 - acc: 0.0200 - ETA: 497s - loss: 4.7358 - acc: 0.0197 - ETA: 498s - loss: 4.7359 - acc: 0.0194 - ETA: 500s - loss: 4.7369 - acc: 0.0191 - ETA: 504s - loss: 4.7370 - acc: 0.0188 - ETA: 505s - loss: 4.7391 - acc: 0.0186 - ETA: 507s - loss: 4.7375 - acc: 0.0183 - ETA: 508s - loss: 4.7398 - acc: 0.0188 - ETA: 509s - loss: 4.7383 - acc: 0.0185 - ETA: 510s - loss: 4.7393 - acc: 0.0182 - ETA: 510s - loss: 4.7391 - acc: 0.0180 - ETA: 511s - loss: 4.7371 - acc: 0.0178 - ETA: 511s - loss: 4.7386 - acc: 0.0175 - ETA: 511s - loss: 4.7416 - acc: 0.0179 - ETA: 515s - loss: 4.7415 - acc: 0.0177 - ETA: 515s - loss: 4.7445 - acc: 0.0175 - ETA: 514s - loss: 4.7426 - acc: 0.0173 - ETA: 515s - loss: 4.7410 - acc: 0.0171 - ETA: 515s - loss: 4.7399 - acc: 0.0175 - ETA: 513s - loss: 4.7389 - acc: 0.0179 - ETA: 513s - loss: 4.7416 - acc: 0.0176 - ETA: 512s - loss: 4.7435 - acc: 0.0174 - ETA: 510s - loss: 4.7433 - acc: 0.0172 - ETA: 524s - loss: 4.7444 - acc: 0.0170 - ETA: 536s - loss: 4.7443 - acc: 0.0169 - ETA: 540s - loss: 4.7452 - acc: 0.0167 - ETA: 539s - loss: 4.7448 - acc: 0.0165 - ETA: 537s - loss: 4.7455 - acc: 0.0168 - ETA: 542s - loss: 4.7458 - acc: 0.0167 - ETA: 543s - loss: 4.7462 - acc: 0.0165 - ETA: 542s - loss: 4.7459 - acc: 0.0163 - ETA: 538s - loss: 4.7467 - acc: 0.0167 - ETA: 552s - loss: 4.7480 - acc: 0.0165 - ETA: 567s - loss: 4.7486 - acc: 0.0163 - ETA: 563s - loss: 4.7482 - acc: 0.0162 - ETA: 559s - loss: 4.7491 - acc: 0.0160 - ETA: 556s - loss: 4.7498 - acc: 0.0163 - ETA: 553s - loss: 4.7489 - acc: 0.0162 - ETA: 551s - loss: 4.7483 - acc: 0.0160 - ETA: 547s - loss: 4.7495 - acc: 0.0163 - ETA: 544s - loss: 4.7495 - acc: 0.0162 - ETA: 541s - loss: 4.7505 - acc: 0.0160 - ETA: 537s - loss: 4.7509 - acc: 0.0164 - ETA: 534s - loss: 4.7503 - acc: 0.0171 - ETA: 532s - loss: 4.7496 - acc: 0.0174 - ETA: 528s - loss: 4.7495 - acc: 0.0173 - ETA: 525s - loss: 4.7502 - acc: 0.0176 - ETA: 521s - loss: 4.7507 - acc: 0.0174 - ETA: 518s - loss: 4.7526 - acc: 0.0181 - ETA: 515s - loss: 4.7519 - acc: 0.0184 - ETA: 512s - loss: 4.7503 - acc: 0.0183 - ETA: 509s - loss: 4.7515 - acc: 0.0181 - ETA: 506s - loss: 4.7510 - acc: 0.0188 - ETA: 502s - loss: 4.7522 - acc: 0.0186 - ETA: 504s - loss: 4.7517 - acc: 0.0185 - ETA: 504s - loss: 4.7514 - acc: 0.0183 - ETA: 503s - loss: 4.7508 - acc: 0.0186 - ETA: 505s - loss: 4.7519 - acc: 0.0184 - ETA: 504s - loss: 4.7512 - acc: 0.0183 - ETA: 501s - loss: 4.7499 - acc: 0.0181 - ETA: 498s - loss: 4.7484 - acc: 0.0184 - ETA: 496s - loss: 4.7482 - acc: 0.0183 - ETA: 492s - loss: 4.7478 - acc: 0.0181 - ETA: 489s - loss: 4.7479 - acc: 0.0180 - ETA: 489s - loss: 4.7469 - acc: 0.0178 - ETA: 488s - loss: 4.7467 - acc: 0.0177 - ETA: 487s - loss: 4.7483 - acc: 0.0176 - ETA: 485s - loss: 4.7491 - acc: 0.0174 - ETA: 485s - loss: 4.7497 - acc: 0.0173 - ETA: 486s - loss: 4.7492 - acc: 0.0172 - ETA: 486s - loss: 4.7501 - acc: 0.0174 - ETA: 487s - loss: 4.7512 - acc: 0.0173 - ETA: 488s - loss: 4.7516 - acc: 0.0172 - ETA: 488s - loss: 4.7504 - acc: 0.0174 - ETA: 489s - loss: 4.7493 - acc: 0.0173 - ETA: 489s - loss: 4.7492 - acc: 0.0171 - ETA: 488s - loss: 4.7498 - acc: 0.0170 - ETA: 490s - loss: 4.7499 - acc: 0.0169 - ETA: 489s - loss: 4.7493 - acc: 0.0168 - ETA: 488s - loss: 4.7480 - acc: 0.0167 - ETA: 484s - loss: 4.7479 - acc: 0.0166 - ETA: 481s - loss: 4.7474 - acc: 0.0168 - ETA: 478s - loss: 4.7483 - acc: 0.0167 - ETA: 480s - loss: 4.7462 - acc: 0.0166 - ETA: 481s - loss: 4.7452 - acc: 0.0164 - ETA: 481s - loss: 4.7457 - acc: 0.0163 - ETA: 481s - loss: 4.7453 - acc: 0.0162 - ETA: 480s - loss: 4.7464 - acc: 0.0164 - ETA: 480s - loss: 4.7475 - acc: 0.0163 - ETA: 480s - loss: 4.7470 - acc: 0.0166 - ETA: 479s - loss: 4.7466 - acc: 0.0165 - ETA: 479s - loss: 4.7464 - acc: 0.0163 - ETA: 484s - loss: 4.7463 - acc: 0.0162 - ETA: 484s - loss: 4.7459 - acc: 0.0161 - ETA: 483s - loss: 4.7465 - acc: 0.0160 - ETA: 481s - loss: 4.7465 - acc: 0.0159 - ETA: 479s - loss: 4.7468 - acc: 0.0158 - ETA: 477s - loss: 4.7470 - acc: 0.0157 - ETA: 476s - loss: 4.7486 - acc: 0.0156 - ETA: 474s - loss: 4.7486 - acc: 0.0155 - ETA: 472s - loss: 4.7488 - acc: 0.0155 - ETA: 470s - loss: 4.7480 - acc: 0.0154 - ETA: 467s - loss: 4.7484 - acc: 0.0156 - ETA: 464s - loss: 4.7478 - acc: 0.0155 - ETA: 463s - loss: 4.7463 - acc: 0.0160 - ETA: 460s - loss: 4.7460 - acc: 0.0159 - ETA: 458s - loss: 4.7462 - acc: 0.0158 - ETA: 458s - loss: 4.7456 - acc: 0.0163 - ETA: 455s - loss: 4.7469 - acc: 0.0162 - ETA: 453s - loss: 4.7480 - acc: 0.0161 - ETA: 450s - loss: 4.7473 - acc: 0.0160 - ETA: 447s - loss: 4.7473 - acc: 0.0159 - ETA: 446s - loss: 4.7469 - acc: 0.0164 - ETA: 443s - loss: 4.7467 - acc: 0.0163 - ETA: 441s - loss: 4.7469 - acc: 0.0162 - ETA: 439s - loss: 4.7465 - acc: 0.0161 - ETA: 436s - loss: 4.7469 - acc: 0.0160 - ETA: 433s - loss: 4.7469 - acc: 0.0159 - ETA: 430s - loss: 4.7465 - acc: 0.0158 - ETA: 434s - loss: 4.7467 - acc: 0.0163 - ETA: 430s - loss: 4.7472 - acc: 0.0165 - ETA: 427s - loss: 4.7470 - acc: 0.0167 - ETA: 423s - loss: 4.7473 - acc: 0.0166 - ETA: 419s - loss: 4.7468 - acc: 0.0170 - ETA: 416s - loss: 4.7463 - acc: 0.0172 - ETA: 412s - loss: 4.7452 - acc: 0.0171 - ETA: 409s - loss: 4.7451 - acc: 0.0170 - ETA: 405s - loss: 4.7440 - acc: 0.0172 - ETA: 401s - loss: 4.7444 - acc: 0.0171 - ETA: 399s - loss: 4.7440 - acc: 0.0173 - ETA: 396s - loss: 4.7445 - acc: 0.0172 - ETA: 394s - loss: 4.7439 - acc: 0.0171 - ETA: 390s - loss: 4.7437 - acc: 0.0173 - ETA: 387s - loss: 4.7438 - acc: 0.0172 - ETA: 383s - loss: 4.7432 - acc: 0.0171 - ETA: 380s - loss: 4.7436 - acc: 0.0170 - ETA: 376s - loss: 4.7431 - acc: 0.0172 - ETA: 373s - loss: 4.7426 - acc: 0.0173 - ETA: 370s - loss: 4.7424 - acc: 0.0172 - ETA: 366s - loss: 4.7417 - acc: 0.0172 - ETA: 363s - loss: 4.7414 - acc: 0.0171 - ETA: 359s - loss: 4.7429 - acc: 0.0170 - ETA: 356s - loss: 4.7433 - acc: 0.0169 - ETA: 353s - loss: 4.7439 - acc: 0.0168 - ETA: 352s - loss: 4.7434 - acc: 0.0170 - ETA: 348s - loss: 4.7444 - acc: 0.0169 - ETA: 345s - loss: 4.7449 - acc: 0.0168 - ETA: 342s - loss: 4.7446 - acc: 0.0167 - ETA: 338s - loss: 4.7447 - acc: 0.0167 - ETA: 335s - loss: 4.7456 - acc: 0.0171 - ETA: 332s - loss: 4.7455 - acc: 0.0174 - ETA: 328s - loss: 4.7456 - acc: 0.0176 - ETA: 325s - loss: 4.7447 - acc: 0.0175 - ETA: 322s - loss: 4.7448 - acc: 0.0174 - ETA: 318s - loss: 4.7443 - acc: 0.0174 - ETA: 315s - loss: 4.7438 - acc: 0.0175 - ETA: 312s - loss: 4.7447 - acc: 0.0176 - ETA: 309s - loss: 4.7446 - acc: 0.0176 - ETA: 306s - loss: 4.7442 - acc: 0.0177 - ETA: 309s - loss: 4.7441 - acc: 0.0176 - ETA: 310s - loss: 4.7437 - acc: 0.0176 - ETA: 307s - loss: 4.7433 - acc: 0.0177 - ETA: 304s - loss: 4.7427 - acc: 0.0178 - ETA: 300s - loss: 4.7426 - acc: 0.0178 - ETA: 297s - loss: 4.7428 - acc: 0.0177 - ETA: 293s - loss: 4.7425 - acc: 0.0176 - ETA: 291s - loss: 4.7425 - acc: 0.0175 - ETA: 287s - loss: 4.7428 - acc: 0.0175 - ETA: 284s - loss: 4.7412 - acc: 0.0174 - ETA: 281s - loss: 4.7409 - acc: 0.0175 - ETA: 278s - loss: 4.7406 - acc: 0.0174 - ETA: 274s - loss: 4.7408 - acc: 0.0176 - ETA: 271s - loss: 4.7405 - acc: 0.0175 - ETA: 268s - loss: 4.7406 - acc: 0.0174 - ETA: 265s - loss: 4.7403 - acc: 0.0174 - ETA: 262s - loss: 4.7394 - acc: 0.0173 - ETA: 258s - loss: 4.7387 - acc: 0.0174 - ETA: 255s - loss: 4.7380 - acc: 0.0174 - ETA: 252s - loss: 4.7380 - acc: 0.0175 - ETA: 249s - loss: 4.7372 - acc: 0.0174 - ETA: 246s - loss: 4.7365 - acc: 0.0176 - ETA: 243s - loss: 4.7363 - acc: 0.0175 - ETA: 240s - loss: 4.7362 - acc: 0.0174 - ETA: 237s - loss: 4.7355 - acc: 0.0175 - ETA: 234s - loss: 4.7351 - acc: 0.0175 - ETA: 230s - loss: 4.7372 - acc: 0.0174 - ETA: 227s - loss: 4.7363 - acc: 0.0177 - ETA: 224s - loss: 4.7359 - acc: 0.0181 - ETA: 221s - loss: 4.7359 - acc: 0.0182 - ETA: 219s - loss: 4.7353 - acc: 0.0181 - ETA: 216s - loss: 4.7360 - acc: 0.0180 - ETA: 213s - loss: 4.7357 - acc: 0.0180 - ETA: 210s - loss: 4.7361 - acc: 0.0181 - ETA: 207s - loss: 4.7357 - acc: 0.0180 - ETA: 205s - loss: 4.7362 - acc: 0.0180 - ETA: 202s - loss: 4.7357 - acc: 0.0179 - ETA: 199s - loss: 4.7358 - acc: 0.0178 - ETA: 196s - loss: 4.7360 - acc: 0.0177 - ETA: 194s - loss: 4.7356 - acc: 0.0179 - ETA: 191s - loss: 4.7354 - acc: 0.0178 - ETA: 188s - loss: 4.7347 - acc: 0.0179 - ETA: 186s - loss: 4.7347 - acc: 0.0179 - ETA: 184s - loss: 4.7345 - acc: 0.0178 - ETA: 181s - loss: 4.7334 - acc: 0.0177 - ETA: 179s - loss: 4.7327 - acc: 0.0177 - ETA: 176s - loss: 4.7327 - acc: 0.0176 - ETA: 173s - loss: 4.7325 - acc: 0.0175 - ETA: 171s - loss: 4.7321 - acc: 0.0175 - ETA: 168s - loss: 4.7330 - acc: 0.0174 - ETA: 165s - loss: 4.7333 - acc: 0.0175 - ETA: 163s - loss: 4.7334 - acc: 0.0175 - ETA: 160s - loss: 4.7339 - acc: 0.0174 - ETA: 158s - loss: 4.7342 - acc: 0.0173 - ETA: 155s - loss: 4.7348 - acc: 0.0173 - ETA: 152s - loss: 4.7350 - acc: 0.0172 - ETA: 149s - loss: 4.7349 - acc: 0.0173 - ETA: 147s - loss: 4.7349 - acc: 0.0174 - ETA: 144s - loss: 4.7350 - acc: 0.0176 - ETA: 142s - loss: 4.7352 - acc: 0.0177 - ETA: 139s - loss: 4.7351 - acc: 0.0176 - ETA: 137s - loss: 4.7344 - acc: 0.0175 - ETA: 135s - loss: 4.7339 - acc: 0.0175 - ETA: 132s - loss: 4.7337 - acc: 0.0176 - ETA: 130s - loss: 4.7341 - acc: 0.0177 - ETA: 127s - loss: 4.7334 - acc: 0.0176 - ETA: 124s - loss: 4.7334 - acc: 0.0176 - ETA: 121s - loss: 4.7330 - acc: 0.0175 - ETA: 118s - loss: 4.7330 - acc: 0.0175 - ETA: 115s - loss: 4.7336 - acc: 0.0174 - ETA: 112s - loss: 4.7336 - acc: 0.0173 - ETA: 109s - loss: 4.7333 - acc: 0.0173 - ETA: 106s - loss: 4.7329 - acc: 0.0174 - ETA: 103s - loss: 4.7333 - acc: 0.0173 - ETA: 101s - loss: 4.7331 - acc: 0.0173 - ETA: 98s - loss: 4.7325 - acc: 0.0172  - ETA: 95s - loss: 4.7322 - acc: 0.0172 - ETA: 92s - loss: 4.7322 - acc: 0.0173 - ETA: 89s - loss: 4.7324 - acc: 0.0174 - ETA: 86s - loss: 4.7330 - acc: 0.0173 - ETA: 83s - loss: 4.7331 - acc: 0.0173 - ETA: 80s - loss: 4.7333 - acc: 0.0172 - ETA: 78s - loss: 4.7327 - acc: 0.0172 - ETA: 75s - loss: 4.7328 - acc: 0.0171 - ETA: 72s - loss: 4.7320 - acc: 0.0172 - ETA: 69s - loss: 4.7333 - acc: 0.0172 - ETA: 67s - loss: 4.7333 - acc: 0.0176 - ETA: 64s - loss: 4.7331 - acc: 0.0175 - ETA: 61s - loss: 4.7333 - acc: 0.0175 - ETA: 58s - loss: 4.7338 - acc: 0.0176 - ETA: 55s - loss: 4.7335 - acc: 0.0175 - ETA: 54s - loss: 4.7337 - acc: 0.0176 - ETA: 51s - loss: 4.7344 - acc: 0.0176 - ETA: 48s - loss: 4.7347 - acc: 0.0175 - ETA: 45s - loss: 4.7342 - acc: 0.0175 - ETA: 43s - loss: 4.7342 - acc: 0.0174 - ETA: 40s - loss: 4.7337 - acc: 0.0177 - ETA: 37s - loss: 4.7333 - acc: 0.0176 - ETA: 34s - loss: 4.7328 - acc: 0.0175 - ETA: 31s - loss: 4.7324 - acc: 0.0175 - ETA: 28s - loss: 4.7326 - acc: 0.0176 - ETA: 25s - loss: 4.7326 - acc: 0.0177 - ETA: 22s - loss: 4.7334 - acc: 0.0176 - ETA: 19s - loss: 4.7333 - acc: 0.0176 - ETA: 17s - loss: 4.7335 - acc: 0.0175 - ETA: 14s - loss: 4.7336 - acc: 0.0175 - ETA: 11s - loss: 4.7337 - acc: 0.0174 - ETA: 8s - loss: 4.7338 - acc: 0.0174  - ETA: 5s - loss: 4.7337 - acc: 0.0173 - ETA: 2s - loss: 4.7343 - acc: 0.0173Epoch 00004: val_loss improved from 4.75076 to 4.72593, saving model to saved_models/weights.best.from_scratch.hdf5
6680/6680 [==============================] - 1023s - loss: 4.7338 - acc: 0.0172 - val_loss: 4.7259 - val_acc: 0.0263
Out[41]:
<keras.callbacks.History at 0x1abf2d7cac8>

Load the Model with the Best Validation Loss

In [42]:
model.load_weights('saved_models/weights.best.from_scratch.hdf5')

Test the Model

Try out your model on the test dataset of dog images. Ensure that your test accuracy is greater than 1%.

In [43]:
# get index of predicted dog breed for each image in test set
dog_breed_predictions = [np.argmax(model.predict(np.expand_dims(tensor, axis=0))) for tensor in test_tensors]

# report test accuracy
test_accuracy = 100*np.sum(np.array(dog_breed_predictions)==np.argmax(test_targets, axis=1))/len(dog_breed_predictions)
print('Test accuracy: %.4f%%' % test_accuracy)

Test accuracy: 2.6316%

Step 4: Use a CNN to Classify Dog Breeds

To reduce training time without sacrificing accuracy, we show you how to train a CNN using transfer learning. In the following step, you will get a chance to use transfer learning to train your own CNN.

Obtain Bottleneck Features

In [46]:
bottleneck_features = np.load('bottleneck_features/DogVGG16Data.npz')
train_VGG16 = bottleneck_features['train']
valid_VGG16 = bottleneck_features['valid']
test_VGG16 = bottleneck_features['test']

Model Architecture

The model uses the the pre-trained VGG-16 model as a fixed feature extractor, where the last convolutional output of VGG-16 is fed as input to our model. We only add a global average pooling layer and a fully connected layer, where the latter contains one node for each dog category and is equipped with a softmax.

In [47]:
VGG16_model = Sequential()
VGG16_model.add(GlobalAveragePooling2D(input_shape=train_VGG16.shape[1:]))
VGG16_model.add(Dense(133, activation='softmax'))

VGG16_model.summary()

_________________________________________________________________
Layer (type)                 Output Shape              Param #   
=================================================================
global_average_pooling2d_13  (None, 512)               0         
_________________________________________________________________
dense_15 (Dense)             (None, 133)               68229     
=================================================================
Total params: 68,229.0
Trainable params: 68,229.0
Non-trainable params: 0.0
_________________________________________________________________

Compile the Model

In [49]:
VGG16_model.compile(loss='categorical_crossentropy', optimizer='rmsprop', metrics=['accuracy'])

Train the Model

In [50]:
checkpointer = ModelCheckpoint(filepath='saved_models/weights.best.VGG16.hdf5', 
                               verbose=1, save_best_only=True)

VGG16_model.fit(train_VGG16, train_targets, 
          validation_data=(valid_VGG16, valid_targets),
          epochs=20, batch_size=20, callbacks=[checkpointer], verbose=1)

Train on 6680 samples, validate on 835 samples
Epoch 1/20
  40/6680 [..............................] - ETA: 23748s - loss: 13.4157 - acc: 0.0000e+00 - ETA: 11896s - loss: 13.8505 - acc: 0.0250    
C:\Users\felix\Anaconda2\envs\dog-project\lib\site-packages\keras\callbacks.py:118: UserWarning: Method on_batch_end() is slow compared to the batch update (0.109862). Check your callbacks.
  % delta_t_median)

6660/6680 [============================>.] - ETA: 8013s - loss: 14.2809 - acc: 0.0167  - ETA: 6013s - loss: 14.3850 - acc: 0.0125 - ETA: 4811s - loss: 14.5203 - acc: 0.0100 - ETA: 4010s - loss: 14.6588 - acc: 0.0083 - ETA: 3430s - loss: 14.5825 - acc: 0.0143 - ETA: 2998s - loss: 14.7453 - acc: 0.0125 - ETA: 2659s - loss: 14.8575 - acc: 0.0111 - ETA: 2389s - loss: 14.9167 - acc: 0.0100 - ETA: 2172s - loss: 14.8200 - acc: 0.0091 - ETA: 1988s - loss: 14.8836 - acc: 0.0083 - ETA: 1832s - loss: 14.8347 - acc: 0.0115 - ETA: 1699s - loss: 14.8731 - acc: 0.0107 - ETA: 1583s - loss: 14.8131 - acc: 0.0100 - ETA: 1482s - loss: 14.7645 - acc: 0.0156 - ETA: 1392s - loss: 14.7320 - acc: 0.0147 - ETA: 1312s - loss: 14.7910 - acc: 0.0139 - ETA: 1240s - loss: 14.7751 - acc: 0.0132 - ETA: 1175s - loss: 14.8259 - acc: 0.0125 - ETA: 1117s - loss: 14.8203 - acc: 0.0119 - ETA: 1064s - loss: 14.8787 - acc: 0.0114 - ETA: 1015s - loss: 14.8219 - acc: 0.0130 - ETA: 971s - loss: 14.7740 - acc: 0.0146  - ETA: 891s - loss: 14.7778 - acc: 0.0154 - ETA: 857s - loss: 14.7998 - acc: 0.0148 - ETA: 825s - loss: 14.7776 - acc: 0.0143 - ETA: 766s - loss: 14.7561 - acc: 0.0167 - ETA: 739s - loss: 14.7172 - acc: 0.0177 - ETA: 714s - loss: 14.7240 - acc: 0.0172 - ETA: 691s - loss: 14.7376 - acc: 0.0167 - ETA: 669s - loss: 14.7243 - acc: 0.0162 - ETA: 628s - loss: 14.7508 - acc: 0.0153 - ETA: 610s - loss: 14.7044 - acc: 0.0162 - ETA: 575s - loss: 14.7448 - acc: 0.0154 - ETA: 559s - loss: 14.7407 - acc: 0.0163 - ETA: 530s - loss: 14.7079 - acc: 0.0167 - ETA: 516s - loss: 14.6875 - acc: 0.0174 - ETA: 503s - loss: 14.7117 - acc: 0.0170 - ETA: 490s - loss: 14.7119 - acc: 0.0178 - ETA: 478s - loss: 14.7190 - acc: 0.0174 - ETA: 467s - loss: 14.7084 - acc: 0.0170 - ETA: 435s - loss: 14.6892 - acc: 0.0180 - ETA: 415s - loss: 14.6452 - acc: 0.0192 - ETA: 397s - loss: 14.6325 - acc: 0.0194 - ETA: 381s - loss: 14.5891 - acc: 0.0223 - ETA: 373s - loss: 14.6016 - acc: 0.0219 - ETA: 366s - loss: 14.5931 - acc: 0.0216 - ETA: 351s - loss: 14.5695 - acc: 0.0233 - ETA: 344s - loss: 14.5526 - acc: 0.0230 - ETA: 331s - loss: 14.5553 - acc: 0.0230 - ETA: 325s - loss: 14.5645 - acc: 0.0227 - ETA: 313s - loss: 14.5176 - acc: 0.0250 - ETA: 307s - loss: 14.5092 - acc: 0.0246 - ETA: 302s - loss: 14.5135 - acc: 0.0250 - ETA: 291s - loss: 14.4808 - acc: 0.0264 - ETA: 281s - loss: 14.4655 - acc: 0.0264 - ETA: 272s - loss: 14.4082 - acc: 0.0270 - ETA: 263s - loss: 14.3868 - acc: 0.0283 - ETA: 259s - loss: 14.3712 - acc: 0.0279 - ETA: 255s - loss: 14.3676 - acc: 0.0282 - ETA: 247s - loss: 14.3155 - acc: 0.0313 - ETA: 243s - loss: 14.2840 - acc: 0.0327 - ETA: 239s - loss: 14.2697 - acc: 0.0329 - ETA: 232s - loss: 14.2283 - acc: 0.0327 - ETA: 228s - loss: 14.2360 - acc: 0.0324 - ETA: 221s - loss: 14.1841 - acc: 0.0368 - ETA: 215s - loss: 14.1329 - acc: 0.0382 - ETA: 209s - loss: 14.0782 - acc: 0.0412 - ETA: 203s - loss: 14.0227 - acc: 0.0430 - ETA: 197s - loss: 13.9953 - acc: 0.0432 - ETA: 194s - loss: 13.9868 - acc: 0.0432 - ETA: 191s - loss: 13.9568 - acc: 0.0443 - ETA: 189s - loss: 13.9311 - acc: 0.0454 - ETA: 186s - loss: 13.9263 - acc: 0.0455 - ETA: 184s - loss: 13.9386 - acc: 0.0450 - ETA: 181s - loss: 13.9189 - acc: 0.0450 - ETA: 176s - loss: 13.8833 - acc: 0.0461 - ETA: 174s - loss: 13.8785 - acc: 0.0466 - ETA: 169s - loss: 13.8594 - acc: 0.0476 - ETA: 167s - loss: 13.8502 - acc: 0.0481 - ETA: 163s - loss: 13.8431 - acc: 0.0482 - ETA: 159s - loss: 13.8199 - acc: 0.0477 - ETA: 155s - loss: 13.8131 - acc: 0.0473 - ETA: 151s - loss: 13.7554 - acc: 0.0500 - ETA: 149s - loss: 13.7604 - acc: 0.0500 - ETA: 145s - loss: 13.7475 - acc: 0.0513 - ETA: 142s - loss: 13.7226 - acc: 0.0525 - ETA: 138s - loss: 13.7240 - acc: 0.0525 - ETA: 136s - loss: 13.7014 - acc: 0.0524 - ETA: 133s - loss: 13.7036 - acc: 0.0528 - ETA: 128s - loss: 13.6694 - acc: 0.0539 - ETA: 125s - loss: 13.6558 - acc: 0.0538 - ETA: 122s - loss: 13.6583 - acc: 0.0530 - ETA: 119s - loss: 13.6129 - acc: 0.0545 - ETA: 116s - loss: 13.6091 - acc: 0.0551 - ETA: 114s - loss: 13.5766 - acc: 0.0558 - ETA: 112s - loss: 13.5718 - acc: 0.0565 - ETA: 110s - loss: 13.5629 - acc: 0.0571 - ETA: 108s - loss: 13.5560 - acc: 0.0577 - ETA: 107s - loss: 13.5406 - acc: 0.0580 - ETA: 105s - loss: 13.5151 - acc: 0.0593 - ETA: 102s - loss: 13.4787 - acc: 0.0602 - ETA: 100s - loss: 13.4722 - acc: 0.0604 - ETA: 97s - loss: 13.4557 - acc: 0.0616  - ETA: 96s - loss: 13.4497 - acc: 0.0622 - ETA: 95s - loss: 13.4241 - acc: 0.0624 - ETA: 94s - loss: 13.4119 - acc: 0.0627 - ETA: 92s - loss: 13.3856 - acc: 0.0641 - ETA: 90s - loss: 13.3645 - acc: 0.0652 - ETA: 89s - loss: 13.3642 - acc: 0.0651 - ETA: 88s - loss: 13.3540 - acc: 0.0653 - ETA: 87s - loss: 13.3460 - acc: 0.0652 - ETA: 85s - loss: 13.3250 - acc: 0.0660 - ETA: 84s - loss: 13.3208 - acc: 0.0665 - ETA: 83s - loss: 13.3091 - acc: 0.0673 - ETA: 82s - loss: 13.3117 - acc: 0.0672 - ETA: 80s - loss: 13.2972 - acc: 0.0673 - ETA: 77s - loss: 13.2648 - acc: 0.0693 - ETA: 76s - loss: 13.2492 - acc: 0.0699 - ETA: 75s - loss: 13.2474 - acc: 0.0698 - ETA: 73s - loss: 13.2193 - acc: 0.0719 - ETA: 72s - loss: 13.2113 - acc: 0.0723 - ETA: 70s - loss: 13.1861 - acc: 0.0731 - ETA: 68s - loss: 13.1871 - acc: 0.0734 - ETA: 67s - loss: 13.1856 - acc: 0.0742 - ETA: 66s - loss: 13.1810 - acc: 0.0743 - ETA: 64s - loss: 13.1841 - acc: 0.0743 - ETA: 63s - loss: 13.1610 - acc: 0.0757 - ETA: 61s - loss: 13.1316 - acc: 0.0767 - ETA: 59s - loss: 13.1122 - acc: 0.0784 - ETA: 58s - loss: 13.0932 - acc: 0.0791 - ETA: 56s - loss: 13.0856 - acc: 0.0790 - ETA: 56s - loss: 13.0697 - acc: 0.0799 - ETA: 54s - loss: 13.0451 - acc: 0.0813 - ETA: 53s - loss: 13.0298 - acc: 0.0820 - ETA: 52s - loss: 13.0056 - acc: 0.0832 - ETA: 50s - loss: 12.9912 - acc: 0.0838 - ETA: 49s - loss: 12.9898 - acc: 0.0840 - ETA: 48s - loss: 12.9678 - acc: 0.0851 - ETA: 47s - loss: 12.9550 - acc: 0.0862 - ETA: 46s - loss: 12.9475 - acc: 0.0864 - ETA: 46s - loss: 12.9324 - acc: 0.0870 - ETA: 44s - loss: 12.9262 - acc: 0.0878 - ETA: 43s - loss: 12.9098 - acc: 0.0888 - ETA: 42s - loss: 12.8825 - acc: 0.0896 - ETA: 41s - loss: 12.8537 - acc: 0.0910 - ETA: 40s - loss: 12.8558 - acc: 0.0907 - ETA: 39s - loss: 12.8411 - acc: 0.0910 - ETA: 38s - loss: 12.8310 - acc: 0.0917 - ETA: 36s - loss: 12.8019 - acc: 0.0922 - ETA: 35s - loss: 12.7769 - acc: 0.0940 - ETA: 34s - loss: 12.7630 - acc: 0.0947 - ETA: 33s - loss: 12.7571 - acc: 0.0947 - ETA: 32s - loss: 12.7487 - acc: 0.0952 - ETA: 31s - loss: 12.7409 - acc: 0.0961 - ETA: 30s - loss: 12.7150 - acc: 0.0969 - ETA: 29s - loss: 12.6958 - acc: 0.0978 - ETA: 28s - loss: 12.6984 - acc: 0.0976 - ETA: 27s - loss: 12.6704 - acc: 0.0988 - ETA: 26s - loss: 12.6669 - acc: 0.0984 - ETA: 26s - loss: 12.6640 - acc: 0.0988 - ETA: 25s - loss: 12.6561 - acc: 0.0996 - ETA: 24s - loss: 12.6391 - acc: 0.1010 - ETA: 23s - loss: 12.6213 - acc: 0.1017 - ETA: 22s - loss: 12.6117 - acc: 0.1017 - ETA: 21s - loss: 12.6031 - acc: 0.1026 - ETA: 20s - loss: 12.5984 - acc: 0.1028 - ETA: 20s - loss: 12.5726 - acc: 0.1044 - ETA: 19s - loss: 12.5560 - acc: 0.1053 - ETA: 18s - loss: 12.5436 - acc: 0.1053 - ETA: 17s - loss: 12.5312 - acc: 0.1062 - ETA: 17s - loss: 12.5369 - acc: 0.1065 - ETA: 16s - loss: 12.5225 - acc: 0.1070 - ETA: 15s - loss: 12.4983 - acc: 0.1083 - ETA: 14s - loss: 12.4816 - acc: 0.1093 - ETA: 14s - loss: 12.4799 - acc: 0.1096 - ETA: 13s - loss: 12.4775 - acc: 0.1099 - ETA: 12s - loss: 12.4618 - acc: 0.1109 - ETA: 12s - loss: 12.4341 - acc: 0.1122 - ETA: 11s - loss: 12.4158 - acc: 0.1129 - ETA: 10s - loss: 12.4011 - acc: 0.1137 - ETA: 10s - loss: 12.3934 - acc: 0.1141 - ETA: 9s - loss: 12.3797 - acc: 0.1150  - ETA: 8s - loss: 12.3714 - acc: 0.1153 - ETA: 8s - loss: 12.3614 - acc: 0.1157 - ETA: 7s - loss: 12.3478 - acc: 0.1164 - ETA: 6s - loss: 12.3346 - acc: 0.1168 - ETA: 6s - loss: 12.3376 - acc: 0.1170 - ETA: 5s - loss: 12.3235 - acc: 0.1182 - ETA: 5s - loss: 12.2952 - acc: 0.1200 - ETA: 4s - loss: 12.2988 - acc: 0.1200 - ETA: 4s - loss: 12.2883 - acc: 0.1204 - ETA: 3s - loss: 12.2652 - acc: 0.1213 - ETA: 2s - loss: 12.2580 - acc: 0.1220 - ETA: 2s - loss: 12.2471 - acc: 0.1229 - ETA: 1s - loss: 12.2461 - acc: 0.1229 - ETA: 1s - loss: 12.2357 - acc: 0.1234 - ETA: 0s - loss: 12.2357 - acc: 0.1231 - ETA: 0s - loss: 12.2137 - acc: 0.1243Epoch 00000: val_loss improved from inf to 10.80809, saving model to saved_models/weights.best.VGG16.hdf5
6680/6680 [==============================] - 93s - loss: 12.2160 - acc: 0.1243 - val_loss: 10.8081 - val_acc: 0.2012
Epoch 2/20
6620/6680 [============================>.] - ETA: 33s - loss: 13.2811 - acc: 0.0500 - ETA: 13s - loss: 11.4425 - acc: 0.1875 - ETA: 12s - loss: 11.0165 - acc: 0.2167 - ETA: 11s - loss: 10.7167 - acc: 0.2188 - ETA: 10s - loss: 10.4397 - acc: 0.2400 - ETA: 9s - loss: 10.5158 - acc: 0.2417  - ETA: 9s - loss: 10.3710 - acc: 0.2571 - ETA: 9s - loss: 10.2320 - acc: 0.2656 - ETA: 9s - loss: 10.1679 - acc: 0.2694 - ETA: 8s - loss: 10.4140 - acc: 0.2550 - ETA: 8s - loss: 10.5563 - acc: 0.2477 - ETA: 8s - loss: 10.6271 - acc: 0.2458 - ETA: 8s - loss: 10.4971 - acc: 0.2500 - ETA: 8s - loss: 10.5842 - acc: 0.2500 - ETA: 8s - loss: 10.5454 - acc: 0.2533 - ETA: 8s - loss: 10.5184 - acc: 0.2531 - ETA: 8s - loss: 10.5659 - acc: 0.2515 - ETA: 8s - loss: 10.6017 - acc: 0.2458 - ETA: 7s - loss: 10.6559 - acc: 0.2462 - ETA: 7s - loss: 10.6217 - acc: 0.2512 - ETA: 7s - loss: 10.6276 - acc: 0.2453 - ETA: 7s - loss: 10.5977 - acc: 0.2456 - ETA: 7s - loss: 10.4726 - acc: 0.2521 - ETA: 7s - loss: 10.4925 - acc: 0.2530 - ETA: 7s - loss: 10.5330 - acc: 0.2510 - ETA: 7s - loss: 10.4667 - acc: 0.2546 - ETA: 7s - loss: 10.5667 - acc: 0.2500 - ETA: 7s - loss: 10.5567 - acc: 0.2500 - ETA: 7s - loss: 10.5681 - acc: 0.2467 - ETA: 7s - loss: 10.4972 - acc: 0.2476 - ETA: 7s - loss: 10.5424 - acc: 0.2461 - ETA: 6s - loss: 10.5188 - acc: 0.2439 - ETA: 6s - loss: 10.4882 - acc: 0.2441 - ETA: 6s - loss: 10.4759 - acc: 0.2464 - ETA: 6s - loss: 10.4615 - acc: 0.2465 - ETA: 6s - loss: 10.3799 - acc: 0.2500 - ETA: 6s - loss: 10.4167 - acc: 0.2494 - ETA: 6s - loss: 10.4404 - acc: 0.2487 - ETA: 6s - loss: 10.4273 - acc: 0.2494 - ETA: 6s - loss: 10.4214 - acc: 0.2500 - ETA: 6s - loss: 10.3948 - acc: 0.2529 - ETA: 6s - loss: 10.4289 - acc: 0.2517 - ETA: 6s - loss: 10.4326 - acc: 0.2522 - ETA: 6s - loss: 10.4295 - acc: 0.2527 - ETA: 6s - loss: 10.4029 - acc: 0.2548 - ETA: 6s - loss: 10.3856 - acc: 0.2563 - ETA: 6s - loss: 10.3667 - acc: 0.2552 - ETA: 6s - loss: 10.3969 - acc: 0.2551 - ETA: 6s - loss: 10.3894 - acc: 0.2554 - ETA: 5s - loss: 10.4318 - acc: 0.2534 - ETA: 5s - loss: 10.4151 - acc: 0.2542 - ETA: 5s - loss: 10.3856 - acc: 0.2556 - ETA: 5s - loss: 10.3316 - acc: 0.2564 - ETA: 5s - loss: 10.2996 - acc: 0.2594 - ETA: 5s - loss: 10.2938 - acc: 0.2596 - ETA: 5s - loss: 10.3161 - acc: 0.2591 - ETA: 5s - loss: 10.3226 - acc: 0.2593 - ETA: 5s - loss: 10.3005 - acc: 0.2600 - ETA: 5s - loss: 10.3012 - acc: 0.2611 - ETA: 5s - loss: 10.3143 - acc: 0.2609 - ETA: 5s - loss: 10.3373 - acc: 0.2583 - ETA: 5s - loss: 10.3153 - acc: 0.2582 - ETA: 5s - loss: 10.2961 - acc: 0.2600 - ETA: 5s - loss: 10.2861 - acc: 0.2602 - ETA: 5s - loss: 10.2920 - acc: 0.2593 - ETA: 5s - loss: 10.2818 - acc: 0.2599 - ETA: 5s - loss: 10.2775 - acc: 0.2601 - ETA: 5s - loss: 10.2578 - acc: 0.2607 - ETA: 4s - loss: 10.2481 - acc: 0.2616 - ETA: 4s - loss: 10.2243 - acc: 0.2635 - ETA: 4s - loss: 10.2231 - acc: 0.2644 - ETA: 4s - loss: 10.2190 - acc: 0.2639 - ETA: 4s - loss: 10.1855 - acc: 0.2659 - ETA: 4s - loss: 10.1884 - acc: 0.2650 - ETA: 4s - loss: 10.1899 - acc: 0.2648 - ETA: 4s - loss: 10.2134 - acc: 0.2634 - ETA: 4s - loss: 10.2191 - acc: 0.2635 - ETA: 4s - loss: 10.2188 - acc: 0.2634 - ETA: 4s - loss: 10.2155 - acc: 0.2638 - ETA: 4s - loss: 10.2014 - acc: 0.2655 - ETA: 4s - loss: 10.1989 - acc: 0.2662 - ETA: 4s - loss: 10.1867 - acc: 0.2666 - ETA: 4s - loss: 10.2060 - acc: 0.2655 - ETA: 4s - loss: 10.1930 - acc: 0.2662 - ETA: 4s - loss: 10.2021 - acc: 0.2660 - ETA: 4s - loss: 10.1913 - acc: 0.2667 - ETA: 3s - loss: 10.1973 - acc: 0.2667 - ETA: 3s - loss: 10.2010 - acc: 0.2668 - ETA: 3s - loss: 10.1909 - acc: 0.2677 - ETA: 3s - loss: 10.2036 - acc: 0.2672 - ETA: 3s - loss: 10.1815 - acc: 0.2686 - ETA: 3s - loss: 10.1475 - acc: 0.2704 - ETA: 3s - loss: 10.1412 - acc: 0.2710 - ETA: 3s - loss: 10.1410 - acc: 0.2708 - ETA: 3s - loss: 10.1387 - acc: 0.2716 - ETA: 3s - loss: 10.1338 - acc: 0.2714 - ETA: 3s - loss: 10.1289 - acc: 0.2719 - ETA: 3s - loss: 10.1260 - acc: 0.2723 - ETA: 3s - loss: 10.1274 - acc: 0.2728 - ETA: 3s - loss: 10.1170 - acc: 0.2733 - ETA: 3s - loss: 10.1347 - acc: 0.2719 - ETA: 3s - loss: 10.1546 - acc: 0.2710 - ETA: 3s - loss: 10.1535 - acc: 0.2712 - ETA: 3s - loss: 10.1461 - acc: 0.2715 - ETA: 3s - loss: 10.1545 - acc: 0.2713 - ETA: 2s - loss: 10.1501 - acc: 0.2709 - ETA: 2s - loss: 10.1489 - acc: 0.2709 - ETA: 2s - loss: 10.1547 - acc: 0.2705 - ETA: 2s - loss: 10.1532 - acc: 0.2712 - ETA: 2s - loss: 10.1410 - acc: 0.2718 - ETA: 2s - loss: 10.1274 - acc: 0.2725 - ETA: 2s - loss: 10.1170 - acc: 0.2736 - ETA: 2s - loss: 10.1109 - acc: 0.2732 - ETA: 2s - loss: 10.1169 - acc: 0.2734 - ETA: 2s - loss: 10.1164 - acc: 0.2734 - ETA: 2s - loss: 10.1045 - acc: 0.2738 - ETA: 2s - loss: 10.0934 - acc: 0.2749 - ETA: 2s - loss: 10.0943 - acc: 0.2749 - ETA: 2s - loss: 10.0815 - acc: 0.2757 - ETA: 2s - loss: 10.0878 - acc: 0.2757 - ETA: 2s - loss: 10.0898 - acc: 0.2755 - ETA: 2s - loss: 10.0935 - acc: 0.2757 - ETA: 2s - loss: 10.0839 - acc: 0.2761 - ETA: 2s - loss: 10.0802 - acc: 0.2761 - ETA: 1s - loss: 10.0858 - acc: 0.2759 - ETA: 1s - loss: 10.0829 - acc: 0.2763 - ETA: 1s - loss: 10.0976 - acc: 0.2753 - ETA: 1s - loss: 10.0894 - acc: 0.2759 - ETA: 1s - loss: 10.1023 - acc: 0.2749 - ETA: 1s - loss: 10.0931 - acc: 0.2755 - ETA: 1s - loss: 10.0896 - acc: 0.2757 - ETA: 1s - loss: 10.0762 - acc: 0.2760 - ETA: 1s - loss: 10.0528 - acc: 0.2765 - ETA: 1s - loss: 10.0468 - acc: 0.2774 - ETA: 1s - loss: 10.0376 - acc: 0.2779 - ETA: 1s - loss: 10.0307 - acc: 0.2782 - ETA: 1s - loss: 10.0261 - acc: 0.2784 - ETA: 1s - loss: 10.0206 - acc: 0.2791 - ETA: 1s - loss: 10.0213 - acc: 0.2791 - ETA: 1s - loss: 10.0197 - acc: 0.2794 - ETA: 1s - loss: 10.0159 - acc: 0.2796 - ETA: 1s - loss: 10.0049 - acc: 0.2802 - ETA: 0s - loss: 10.0155 - acc: 0.2802 - ETA: 0s - loss: 10.0181 - acc: 0.2801 - ETA: 0s - loss: 10.0127 - acc: 0.2805 - ETA: 0s - loss: 10.0176 - acc: 0.2803 - ETA: 0s - loss: 10.0182 - acc: 0.2808 - ETA: 0s - loss: 10.0268 - acc: 0.2801 - ETA: 0s - loss: 10.0070 - acc: 0.2812 - ETA: 0s - loss: 10.0020 - acc: 0.2814 - ETA: 0s - loss: 10.0030 - acc: 0.2816 - ETA: 0s - loss: 9.9995 - acc: 0.2817  - ETA: 0s - loss: 10.0029 - acc: 0.2817 - ETA: 0s - loss: 9.9996 - acc: 0.2821  - ETA: 0s - loss: 9.9997 - acc: 0.2822 - ETA: 0s - loss: 10.0069 - acc: 0.2820 - ETA: 0s - loss: 9.9968 - acc: 0.2829  - ETA: 0s - loss: 9.9916 - acc: 0.2836 - ETA: 0s - loss: 9.9981 - acc: 0.2831 - ETA: 0s - loss: 9.9981 - acc: 0.2832Epoch 00001: val_loss improved from 10.80809 to 9.97140, saving model to saved_models/weights.best.VGG16.hdf5
6680/6680 [==============================] - 8s - loss: 9.9979 - acc: 0.2831 - val_loss: 9.9714 - val_acc: 0.2731
Epoch 3/20
6640/6680 [============================>.] - ETA: 6s - loss: 11.3184 - acc: 0.3000 - ETA: 7s - loss: 10.0446 - acc: 0.3333 - ETA: 8s - loss: 9.7626 - acc: 0.3600  - ETA: 7s - loss: 9.2820 - acc: 0.3813 - ETA: 8s - loss: 9.5291 - acc: 0.3700 - ETA: 8s - loss: 9.8136 - acc: 0.3458 - ETA: 8s - loss: 9.7962 - acc: 0.3536 - ETA: 7s - loss: 9.8021 - acc: 0.3559 - ETA: 7s - loss: 9.7293 - acc: 0.3500 - ETA: 7s - loss: 9.3964 - acc: 0.3690 - ETA: 7s - loss: 9.4506 - acc: 0.3630 - ETA: 8s - loss: 9.4914 - acc: 0.3604 - ETA: 8s - loss: 9.6005 - acc: 0.3577 - ETA: 8s - loss: 9.7400 - acc: 0.3446 - ETA: 8s - loss: 9.6778 - acc: 0.3467 - ETA: 8s - loss: 9.6898 - acc: 0.3438 - ETA: 7s - loss: 9.5276 - acc: 0.3485 - ETA: 7s - loss: 9.4942 - acc: 0.3528 - ETA: 7s - loss: 9.5278 - acc: 0.3526 - ETA: 7s - loss: 9.4604 - acc: 0.3575 - ETA: 7s - loss: 9.4899 - acc: 0.3548 - ETA: 7s - loss: 9.4697 - acc: 0.3568 - ETA: 7s - loss: 9.4255 - acc: 0.3576 - ETA: 7s - loss: 9.4535 - acc: 0.3583 - ETA: 7s - loss: 9.6127 - acc: 0.3490 - ETA: 7s - loss: 9.6061 - acc: 0.3471 - ETA: 7s - loss: 9.5612 - acc: 0.3509 - ETA: 7s - loss: 9.4955 - acc: 0.3563 - ETA: 7s - loss: 9.4276 - acc: 0.3603 - ETA: 7s - loss: 9.3897 - acc: 0.3625 - ETA: 7s - loss: 9.3370 - acc: 0.3661 - ETA: 7s - loss: 9.3674 - acc: 0.3641 - ETA: 7s - loss: 9.3707 - acc: 0.3621 - ETA: 7s - loss: 9.3184 - acc: 0.3654 - ETA: 7s - loss: 9.3208 - acc: 0.3657 - ETA: 6s - loss: 9.3851 - acc: 0.3611 - ETA: 6s - loss: 9.3438 - acc: 0.3628 - ETA: 6s - loss: 9.3831 - acc: 0.3597 - ETA: 6s - loss: 9.3662 - acc: 0.3614 - ETA: 6s - loss: 9.3592 - acc: 0.3605 - ETA: 6s - loss: 9.3669 - acc: 0.3614 - ETA: 6s - loss: 9.3594 - acc: 0.3624 - ETA: 6s - loss: 9.3238 - acc: 0.3638 - ETA: 6s - loss: 9.3406 - acc: 0.3629 - ETA: 6s - loss: 9.3693 - acc: 0.3621 - ETA: 6s - loss: 9.3301 - acc: 0.3640 - ETA: 6s - loss: 9.3490 - acc: 0.3621 - ETA: 6s - loss: 9.3465 - acc: 0.3608 - ETA: 6s - loss: 9.3172 - acc: 0.3625 - ETA: 6s - loss: 9.3733 - acc: 0.3593 - ETA: 5s - loss: 9.4333 - acc: 0.3567 - ETA: 5s - loss: 9.4337 - acc: 0.3575 - ETA: 5s - loss: 9.4098 - acc: 0.3596 - ETA: 5s - loss: 9.4086 - acc: 0.3599 - ETA: 5s - loss: 9.4295 - acc: 0.3588 - ETA: 5s - loss: 9.4262 - acc: 0.3573 - ETA: 5s - loss: 9.4101 - acc: 0.3576 - ETA: 5s - loss: 9.3878 - acc: 0.3596 - ETA: 5s - loss: 9.4064 - acc: 0.3582 - ETA: 5s - loss: 9.4222 - acc: 0.3569 - ETA: 5s - loss: 9.4238 - acc: 0.3563 - ETA: 5s - loss: 9.4138 - acc: 0.3562 - ETA: 5s - loss: 9.3921 - acc: 0.3576 - ETA: 5s - loss: 9.3804 - acc: 0.3579 - ETA: 5s - loss: 9.3888 - acc: 0.3570 - ETA: 5s - loss: 9.3987 - acc: 0.3558 - ETA: 4s - loss: 9.4153 - acc: 0.3550 - ETA: 4s - loss: 9.4188 - acc: 0.3553 - ETA: 4s - loss: 9.4138 - acc: 0.3556 - ETA: 4s - loss: 9.4231 - acc: 0.3548 - ETA: 4s - loss: 9.4554 - acc: 0.3530 - ETA: 4s - loss: 9.4823 - acc: 0.3517 - ETA: 4s - loss: 9.4928 - acc: 0.3507 - ETA: 4s - loss: 9.4910 - acc: 0.3506 - ETA: 4s - loss: 9.4911 - acc: 0.3506 - ETA: 4s - loss: 9.5158 - acc: 0.3487 - ETA: 4s - loss: 9.4771 - acc: 0.3515 - ETA: 4s - loss: 9.5014 - acc: 0.3500 - ETA: 4s - loss: 9.4950 - acc: 0.3503 - ETA: 4s - loss: 9.5106 - acc: 0.3494 - ETA: 4s - loss: 9.5194 - acc: 0.3485 - ETA: 4s - loss: 9.5020 - acc: 0.3494 - ETA: 3s - loss: 9.5088 - acc: 0.3477 - ETA: 3s - loss: 9.5322 - acc: 0.3466 - ETA: 3s - loss: 9.5467 - acc: 0.3458 - ETA: 3s - loss: 9.5511 - acc: 0.3454 - ETA: 3s - loss: 9.5483 - acc: 0.3454 - ETA: 3s - loss: 9.5306 - acc: 0.3460 - ETA: 3s - loss: 9.5281 - acc: 0.3463 - ETA: 3s - loss: 9.5397 - acc: 0.3459 - ETA: 3s - loss: 9.5130 - acc: 0.3469 - ETA: 3s - loss: 9.5278 - acc: 0.3464 - ETA: 3s - loss: 9.5383 - acc: 0.3460 - ETA: 3s - loss: 9.5155 - acc: 0.3475 - ETA: 3s - loss: 9.5045 - acc: 0.3480 - ETA: 3s - loss: 9.4901 - acc: 0.3485 - ETA: 3s - loss: 9.4903 - acc: 0.3488 - ETA: 3s - loss: 9.4912 - acc: 0.3486 - ETA: 3s - loss: 9.4871 - acc: 0.3488 - ETA: 2s - loss: 9.4873 - acc: 0.3484 - ETA: 2s - loss: 9.4891 - acc: 0.3481 - ETA: 2s - loss: 9.4960 - acc: 0.3468 - ETA: 2s - loss: 9.5025 - acc: 0.3468 - ETA: 2s - loss: 9.5063 - acc: 0.3466 - ETA: 2s - loss: 9.5160 - acc: 0.3464 - ETA: 2s - loss: 9.5078 - acc: 0.3467 - ETA: 2s - loss: 9.5036 - acc: 0.3472 - ETA: 2s - loss: 9.5036 - acc: 0.3470 - ETA: 2s - loss: 9.5091 - acc: 0.3470 - ETA: 2s - loss: 9.5069 - acc: 0.3468 - ETA: 2s - loss: 9.5005 - acc: 0.3464 - ETA: 2s - loss: 9.5029 - acc: 0.3461 - ETA: 2s - loss: 9.5063 - acc: 0.3459 - ETA: 2s - loss: 9.5016 - acc: 0.3464 - ETA: 2s - loss: 9.4903 - acc: 0.3470 - ETA: 2s - loss: 9.4715 - acc: 0.3478 - ETA: 1s - loss: 9.4587 - acc: 0.3473 - ETA: 1s - loss: 9.4552 - acc: 0.3475 - ETA: 1s - loss: 9.4468 - acc: 0.3479 - ETA: 1s - loss: 9.4224 - acc: 0.3487 - ETA: 1s - loss: 9.4204 - acc: 0.3491 - ETA: 1s - loss: 9.4068 - acc: 0.3498 - ETA: 1s - loss: 9.4097 - acc: 0.3498 - ETA: 1s - loss: 9.4231 - acc: 0.3493 - ETA: 1s - loss: 9.4105 - acc: 0.3502 - ETA: 1s - loss: 9.4020 - acc: 0.3507 - ETA: 1s - loss: 9.4012 - acc: 0.3509 - ETA: 1s - loss: 9.3969 - acc: 0.3511 - ETA: 1s - loss: 9.3936 - acc: 0.3512 - ETA: 1s - loss: 9.3980 - acc: 0.3514 - ETA: 1s - loss: 9.4038 - acc: 0.3514 - ETA: 1s - loss: 9.4046 - acc: 0.3515 - ETA: 0s - loss: 9.4262 - acc: 0.3505 - ETA: 0s - loss: 9.4250 - acc: 0.3508 - ETA: 0s - loss: 9.4209 - acc: 0.3510 - ETA: 0s - loss: 9.4236 - acc: 0.3510 - ETA: 0s - loss: 9.4378 - acc: 0.3503 - ETA: 0s - loss: 9.4353 - acc: 0.3503 - ETA: 0s - loss: 9.4358 - acc: 0.3508 - ETA: 0s - loss: 9.4449 - acc: 0.3505 - ETA: 0s - loss: 9.4532 - acc: 0.3500 - ETA: 0s - loss: 9.4545 - acc: 0.3497 - ETA: 0s - loss: 9.4546 - acc: 0.3495 - ETA: 0s - loss: 9.4532 - acc: 0.3495 - ETA: 0s - loss: 9.4613 - acc: 0.3492 - ETA: 0s - loss: 9.4600 - acc: 0.3494 - ETA: 0s - loss: 9.4529 - acc: 0.3498 - ETA: 0s - loss: 9.4563 - acc: 0.3500 - ETA: 0s - loss: 9.4528 - acc: 0.3503 - ETA: 0s - loss: 9.4438 - acc: 0.3511 - ETA: 0s - loss: 9.4485 - acc: 0.3511Epoch 00002: val_loss improved from 9.97140 to 9.79844, saving model to saved_models/weights.best.VGG16.hdf5
6680/6680 [==============================] - 8s - loss: 9.4464 - acc: 0.3512 - val_loss: 9.7984 - val_acc: 0.3054
Epoch 4/20
6660/6680 [============================>.] - ETA: 46s - loss: 7.3209 - acc: 0.5000 - ETA: 31s - loss: 8.0967 - acc: 0.4750 - ETA: 19s - loss: 9.0219 - acc: 0.3875 - ETA: 14s - loss: 9.3422 - acc: 0.3714 - ETA: 12s - loss: 9.9291 - acc: 0.3444 - ETA: 11s - loss: 9.9216 - acc: 0.3500 - ETA: 10s - loss: 10.0933 - acc: 0.3393 - ETA: 10s - loss: 9.7111 - acc: 0.3625  - ETA: 9s - loss: 9.7740 - acc: 0.3553  - ETA: 9s - loss: 9.4652 - acc: 0.3738 - ETA: 9s - loss: 9.4875 - acc: 0.3739 - ETA: 9s - loss: 9.6959 - acc: 0.3640 - ETA: 8s - loss: 9.4581 - acc: 0.3759 - ETA: 8s - loss: 9.5317 - acc: 0.3724 - ETA: 8s - loss: 9.5342 - acc: 0.3726 - ETA: 8s - loss: 9.4375 - acc: 0.3750 - ETA: 8s - loss: 9.3589 - acc: 0.3797 - ETA: 7s - loss: 9.3680 - acc: 0.3788 - ETA: 7s - loss: 9.4109 - acc: 0.3726 - ETA: 7s - loss: 9.3425 - acc: 0.3750 - ETA: 7s - loss: 9.2717 - acc: 0.3809 - ETA: 7s - loss: 9.3789 - acc: 0.3745 - ETA: 7s - loss: 9.4470 - acc: 0.3696 - ETA: 7s - loss: 9.4076 - acc: 0.3717 - ETA: 7s - loss: 9.3958 - acc: 0.3718 - ETA: 7s - loss: 9.3654 - acc: 0.3746 - ETA: 7s - loss: 9.3355 - acc: 0.3780 - ETA: 7s - loss: 9.2738 - acc: 0.3820 - ETA: 7s - loss: 9.2235 - acc: 0.3865 - ETA: 6s - loss: 9.2197 - acc: 0.3869 - ETA: 6s - loss: 9.2173 - acc: 0.3868 - ETA: 6s - loss: 9.2666 - acc: 0.3843 - ETA: 6s - loss: 9.2606 - acc: 0.3854 - ETA: 6s - loss: 9.2719 - acc: 0.3840 - ETA: 6s - loss: 9.3596 - acc: 0.3801 - ETA: 6s - loss: 9.3592 - acc: 0.3800 - ETA: 6s - loss: 9.3293 - acc: 0.3823 - ETA: 6s - loss: 9.3507 - acc: 0.3804 - ETA: 6s - loss: 9.3585 - acc: 0.3791 - ETA: 6s - loss: 9.3592 - acc: 0.3790 - ETA: 6s - loss: 9.3201 - acc: 0.3819 - ETA: 6s - loss: 9.2598 - acc: 0.3860 - ETA: 5s - loss: 9.2732 - acc: 0.3847 - ETA: 5s - loss: 9.2389 - acc: 0.3866 - ETA: 5s - loss: 9.2318 - acc: 0.3859 - ETA: 5s - loss: 9.2468 - acc: 0.3847 - ETA: 5s - loss: 9.2669 - acc: 0.3835 - ETA: 5s - loss: 9.2745 - acc: 0.3824 - ETA: 5s - loss: 9.2532 - acc: 0.3833 - ETA: 5s - loss: 9.2833 - acc: 0.3818 - ETA: 5s - loss: 9.3098 - acc: 0.3796 - ETA: 5s - loss: 9.3290 - acc: 0.3784 - ETA: 5s - loss: 9.3291 - acc: 0.3780 - ETA: 5s - loss: 9.3055 - acc: 0.3796 - ETA: 5s - loss: 9.3122 - acc: 0.3799 - ETA: 5s - loss: 9.3003 - acc: 0.3806 - ETA: 5s - loss: 9.3009 - acc: 0.3798 - ETA: 5s - loss: 9.3130 - acc: 0.3797 - ETA: 5s - loss: 9.2981 - acc: 0.3804 - ETA: 4s - loss: 9.2690 - acc: 0.3826 - ETA: 4s - loss: 9.2931 - acc: 0.3806 - ETA: 4s - loss: 9.3106 - acc: 0.3788 - ETA: 4s - loss: 9.2698 - acc: 0.3807 - ETA: 4s - loss: 9.2783 - acc: 0.3794 - ETA: 4s - loss: 9.2451 - acc: 0.3821 - ETA: 4s - loss: 9.2177 - acc: 0.3833 - ETA: 4s - loss: 9.2461 - acc: 0.3817 - ETA: 4s - loss: 9.2321 - acc: 0.3826 - ETA: 4s - loss: 9.2408 - acc: 0.3818 - ETA: 4s - loss: 9.2401 - acc: 0.3812 - ETA: 4s - loss: 9.2558 - acc: 0.3808 - ETA: 4s - loss: 9.2545 - acc: 0.3809 - ETA: 4s - loss: 9.2908 - acc: 0.3782 - ETA: 4s - loss: 9.2684 - acc: 0.3783 - ETA: 3s - loss: 9.3047 - acc: 0.3763 - ETA: 3s - loss: 9.2673 - acc: 0.3787 - ETA: 3s - loss: 9.2565 - acc: 0.3798 - ETA: 3s - loss: 9.2582 - acc: 0.3798 - ETA: 3s - loss: 9.2739 - acc: 0.3786 - ETA: 3s - loss: 9.2843 - acc: 0.3783 - ETA: 3s - loss: 9.2749 - acc: 0.3783 - ETA: 3s - loss: 9.2686 - acc: 0.3782 - ETA: 3s - loss: 9.2517 - acc: 0.3790 - ETA: 3s - loss: 9.2387 - acc: 0.3801 - ETA: 3s - loss: 9.2375 - acc: 0.3801 - ETA: 3s - loss: 9.2310 - acc: 0.3797 - ETA: 3s - loss: 9.2397 - acc: 0.3797 - ETA: 3s - loss: 9.2421 - acc: 0.3794 - ETA: 3s - loss: 9.2535 - acc: 0.3790 - ETA: 3s - loss: 9.2704 - acc: 0.3782 - ETA: 3s - loss: 9.3083 - acc: 0.3763 - ETA: 3s - loss: 9.3233 - acc: 0.3760 - ETA: 2s - loss: 9.3064 - acc: 0.3770 - ETA: 2s - loss: 9.3074 - acc: 0.3771 - ETA: 2s - loss: 9.3110 - acc: 0.3768 - ETA: 2s - loss: 9.3132 - acc: 0.3768 - ETA: 2s - loss: 9.3017 - acc: 0.3775 - ETA: 2s - loss: 9.3025 - acc: 0.3772 - ETA: 2s - loss: 9.2987 - acc: 0.3772 - ETA: 2s - loss: 9.3203 - acc: 0.3755 - ETA: 2s - loss: 9.3171 - acc: 0.3760 - ETA: 2s - loss: 9.3055 - acc: 0.3763 - ETA: 2s - loss: 9.3041 - acc: 0.3764 - ETA: 2s - loss: 9.3152 - acc: 0.3752 - ETA: 2s - loss: 9.3373 - acc: 0.3740 - ETA: 2s - loss: 9.3359 - acc: 0.3743 - ETA: 2s - loss: 9.3332 - acc: 0.3745 - ETA: 2s - loss: 9.3359 - acc: 0.3747 - ETA: 1s - loss: 9.3292 - acc: 0.3748 - ETA: 1s - loss: 9.3337 - acc: 0.3744 - ETA: 1s - loss: 9.3399 - acc: 0.3742 - ETA: 1s - loss: 9.3508 - acc: 0.3736 - ETA: 1s - loss: 9.3537 - acc: 0.3737 - ETA: 1s - loss: 9.3626 - acc: 0.3733 - ETA: 1s - loss: 9.3298 - acc: 0.3756 - ETA: 1s - loss: 9.3106 - acc: 0.3766 - ETA: 1s - loss: 9.3091 - acc: 0.3768 - ETA: 1s - loss: 9.2889 - acc: 0.3779 - ETA: 1s - loss: 9.2976 - acc: 0.3777 - ETA: 1s - loss: 9.3103 - acc: 0.3768 - ETA: 1s - loss: 9.3246 - acc: 0.3763 - ETA: 1s - loss: 9.3220 - acc: 0.3764 - ETA: 1s - loss: 9.3265 - acc: 0.3762 - ETA: 1s - loss: 9.3276 - acc: 0.3765 - ETA: 1s - loss: 9.3337 - acc: 0.3760 - ETA: 1s - loss: 9.3358 - acc: 0.3754 - ETA: 1s - loss: 9.3547 - acc: 0.3744 - ETA: 0s - loss: 9.3504 - acc: 0.3746 - ETA: 0s - loss: 9.3379 - acc: 0.3754 - ETA: 0s - loss: 9.3378 - acc: 0.3754 - ETA: 0s - loss: 9.3274 - acc: 0.3758 - ETA: 0s - loss: 9.3138 - acc: 0.3766 - ETA: 0s - loss: 9.3213 - acc: 0.3760 - ETA: 0s - loss: 9.3140 - acc: 0.3765 - ETA: 0s - loss: 9.3037 - acc: 0.3773 - ETA: 0s - loss: 9.3099 - acc: 0.3766 - ETA: 0s - loss: 9.3059 - acc: 0.3771 - ETA: 0s - loss: 9.3033 - acc: 0.3775 - ETA: 0s - loss: 9.2933 - acc: 0.3780 - ETA: 0s - loss: 9.2997 - acc: 0.3777 - ETA: 0s - loss: 9.2971 - acc: 0.3777 - ETA: 0s - loss: 9.2972 - acc: 0.3777 - ETA: 0s - loss: 9.3005 - acc: 0.3777 - ETA: 0s - loss: 9.2884 - acc: 0.3784 - ETA: 0s - loss: 9.2911 - acc: 0.3784 - ETA: 0s - loss: 9.2756 - acc: 0.3792 - ETA: 0s - loss: 9.2616 - acc: 0.3799Epoch 00003: val_loss improved from 9.79844 to 9.75539, saving model to saved_models/weights.best.VGG16.hdf5
6680/6680 [==============================] - 8s - loss: 9.2536 - acc: 0.3804 - val_loss: 9.7554 - val_acc: 0.3138
Epoch 5/20
6640/6680 [============================>.] - ETA: 6s - loss: 7.2638 - acc: 0.5500 - ETA: 7s - loss: 8.6192 - acc: 0.4667 - ETA: 7s - loss: 9.0730 - acc: 0.4250 - ETA: 7s - loss: 8.6354 - acc: 0.4438 - ETA: 7s - loss: 9.0080 - acc: 0.4227 - ETA: 7s - loss: 9.1927 - acc: 0.4077 - ETA: 7s - loss: 9.1727 - acc: 0.4067 - ETA: 7s - loss: 8.9582 - acc: 0.4206 - ETA: 7s - loss: 8.9523 - acc: 0.4211 - ETA: 7s - loss: 8.8983 - acc: 0.4273 - ETA: 7s - loss: 9.0047 - acc: 0.4208 - ETA: 7s - loss: 8.7159 - acc: 0.4389 - ETA: 7s - loss: 8.9004 - acc: 0.4259 - ETA: 7s - loss: 8.9810 - acc: 0.4194 - ETA: 7s - loss: 9.0076 - acc: 0.4167 - ETA: 7s - loss: 9.0371 - acc: 0.4143 - ETA: 6s - loss: 9.0472 - acc: 0.4145 - ETA: 6s - loss: 9.0584 - acc: 0.4150 - ETA: 6s - loss: 8.9832 - acc: 0.4190 - ETA: 6s - loss: 8.9965 - acc: 0.4189 - ETA: 6s - loss: 8.9797 - acc: 0.4202 - ETA: 6s - loss: 9.0461 - acc: 0.4153 - ETA: 6s - loss: 9.0061 - acc: 0.4157 - ETA: 6s - loss: 9.0561 - acc: 0.4132 - ETA: 6s - loss: 8.9912 - acc: 0.4155 - ETA: 6s - loss: 9.0215 - acc: 0.4129 - ETA: 6s - loss: 8.9968 - acc: 0.4133 - ETA: 6s - loss: 9.0133 - acc: 0.4113 - ETA: 6s - loss: 9.0242 - acc: 0.4100 - ETA: 6s - loss: 9.0133 - acc: 0.4090 - ETA: 6s - loss: 9.0167 - acc: 0.4079 - ETA: 6s - loss: 9.0533 - acc: 0.4062 - ETA: 6s - loss: 9.1089 - acc: 0.4020 - ETA: 5s - loss: 9.0963 - acc: 0.4019 - ETA: 5s - loss: 9.1332 - acc: 0.4000 - ETA: 5s - loss: 9.1197 - acc: 0.4006 - ETA: 5s - loss: 9.1427 - acc: 0.4000 - ETA: 5s - loss: 9.0801 - acc: 0.4041 - ETA: 5s - loss: 9.0849 - acc: 0.4046 - ETA: 5s - loss: 9.1034 - acc: 0.4028 - ETA: 5s - loss: 9.1041 - acc: 0.4027 - ETA: 5s - loss: 9.1257 - acc: 0.4016 - ETA: 5s - loss: 9.0860 - acc: 0.4032 - ETA: 5s - loss: 9.1091 - acc: 0.4015 - ETA: 5s - loss: 9.1052 - acc: 0.4015 - ETA: 5s - loss: 9.0892 - acc: 0.4020 - ETA: 5s - loss: 9.0622 - acc: 0.4043 - ETA: 5s - loss: 9.1200 - acc: 0.4009 - ETA: 5s - loss: 9.1085 - acc: 0.4019 - ETA: 5s - loss: 9.1044 - acc: 0.4027 - ETA: 5s - loss: 9.0931 - acc: 0.4040 - ETA: 5s - loss: 9.1457 - acc: 0.4009 - ETA: 5s - loss: 9.1068 - acc: 0.4034 - ETA: 5s - loss: 9.0750 - acc: 0.4058 - ETA: 5s - loss: 9.0948 - acc: 0.4045 - ETA: 4s - loss: 9.0663 - acc: 0.4064 - ETA: 4s - loss: 9.0714 - acc: 0.4059 - ETA: 4s - loss: 9.0579 - acc: 0.4066 - ETA: 4s - loss: 9.0503 - acc: 0.4073 - ETA: 4s - loss: 9.0919 - acc: 0.4049 - ETA: 4s - loss: 9.1259 - acc: 0.4029 - ETA: 4s - loss: 9.1405 - acc: 0.4018 - ETA: 4s - loss: 9.1202 - acc: 0.4032 - ETA: 4s - loss: 9.1506 - acc: 0.4018 - ETA: 4s - loss: 9.1521 - acc: 0.4017 - ETA: 4s - loss: 9.1539 - acc: 0.4020 - ETA: 4s - loss: 9.1551 - acc: 0.4013 - ETA: 4s - loss: 9.1425 - acc: 0.4023 - ETA: 4s - loss: 9.1661 - acc: 0.4010 - ETA: 4s - loss: 9.1540 - acc: 0.4016 - ETA: 4s - loss: 9.1508 - acc: 0.4019 - ETA: 4s - loss: 9.1730 - acc: 0.4006 - ETA: 4s - loss: 9.1729 - acc: 0.4006 - ETA: 4s - loss: 9.1868 - acc: 0.4000 - ETA: 4s - loss: 9.1734 - acc: 0.4012 - ETA: 3s - loss: 9.1800 - acc: 0.4009 - ETA: 3s - loss: 9.1759 - acc: 0.4012 - ETA: 3s - loss: 9.1604 - acc: 0.4015 - ETA: 3s - loss: 9.1508 - acc: 0.4017 - ETA: 3s - loss: 9.1483 - acc: 0.4020 - ETA: 3s - loss: 9.1363 - acc: 0.4031 - ETA: 3s - loss: 9.1300 - acc: 0.4028 - ETA: 3s - loss: 9.1258 - acc: 0.4027 - ETA: 3s - loss: 9.1164 - acc: 0.4030 - ETA: 3s - loss: 9.1065 - acc: 0.4037 - ETA: 3s - loss: 9.1054 - acc: 0.4034 - ETA: 3s - loss: 9.1130 - acc: 0.4028 - ETA: 3s - loss: 9.0975 - acc: 0.4038 - ETA: 3s - loss: 9.1136 - acc: 0.4025 - ETA: 3s - loss: 9.1093 - acc: 0.4023 - ETA: 3s - loss: 9.1166 - acc: 0.4015 - ETA: 3s - loss: 9.1437 - acc: 0.3998 - ETA: 3s - loss: 9.1379 - acc: 0.4002 - ETA: 2s - loss: 9.1257 - acc: 0.4010 - ETA: 2s - loss: 9.1282 - acc: 0.4007 - ETA: 2s - loss: 9.1320 - acc: 0.4005 - ETA: 2s - loss: 9.1432 - acc: 0.3998 - ETA: 2s - loss: 9.1562 - acc: 0.3991 - ETA: 2s - loss: 9.1536 - acc: 0.3995 - ETA: 2s - loss: 9.1731 - acc: 0.3986 - ETA: 2s - loss: 9.1683 - acc: 0.3986 - ETA: 2s - loss: 9.1620 - acc: 0.3993 - ETA: 2s - loss: 9.1631 - acc: 0.3996 - ETA: 2s - loss: 9.1468 - acc: 0.4004 - ETA: 2s - loss: 9.1558 - acc: 0.3998 - ETA: 2s - loss: 9.1482 - acc: 0.4002 - ETA: 2s - loss: 9.1533 - acc: 0.4000 - ETA: 2s - loss: 9.1595 - acc: 0.3996 - ETA: 2s - loss: 9.1558 - acc: 0.3998 - ETA: 2s - loss: 9.1524 - acc: 0.3998 - ETA: 2s - loss: 9.1666 - acc: 0.3992 - ETA: 2s - loss: 9.1491 - acc: 0.4002 - ETA: 2s - loss: 9.1313 - acc: 0.4014 - ETA: 1s - loss: 9.1240 - acc: 0.4014 - ETA: 1s - loss: 9.0969 - acc: 0.4030 - ETA: 1s - loss: 9.1033 - acc: 0.4023 - ETA: 1s - loss: 9.1001 - acc: 0.4021 - ETA: 1s - loss: 9.1087 - acc: 0.4013 - ETA: 1s - loss: 9.1209 - acc: 0.4002 - ETA: 1s - loss: 9.1145 - acc: 0.4008 - ETA: 1s - loss: 9.1233 - acc: 0.4004 - ETA: 1s - loss: 9.1270 - acc: 0.3996 - ETA: 1s - loss: 9.1256 - acc: 0.3998 - ETA: 1s - loss: 9.1255 - acc: 0.4000 - ETA: 1s - loss: 9.1336 - acc: 0.3996 - ETA: 1s - loss: 9.1298 - acc: 0.3998 - ETA: 1s - loss: 9.1387 - acc: 0.3991 - ETA: 1s - loss: 9.1432 - acc: 0.3986 - ETA: 1s - loss: 9.1330 - acc: 0.3993 - ETA: 1s - loss: 9.1383 - acc: 0.3986 - ETA: 1s - loss: 9.1508 - acc: 0.3979 - ETA: 1s - loss: 9.1488 - acc: 0.3983 - ETA: 1s - loss: 9.1379 - acc: 0.3990 - ETA: 1s - loss: 9.1388 - acc: 0.3991 - ETA: 0s - loss: 9.1355 - acc: 0.3993 - ETA: 0s - loss: 9.1421 - acc: 0.3990 - ETA: 0s - loss: 9.1459 - acc: 0.3988 - ETA: 0s - loss: 9.1450 - acc: 0.3987 - ETA: 0s - loss: 9.1441 - acc: 0.3987 - ETA: 0s - loss: 9.1347 - acc: 0.3995 - ETA: 0s - loss: 9.1382 - acc: 0.3995 - ETA: 0s - loss: 9.1366 - acc: 0.3998 - ETA: 0s - loss: 9.1410 - acc: 0.3995 - ETA: 0s - loss: 9.1478 - acc: 0.3990 - ETA: 0s - loss: 9.1489 - acc: 0.3989 - ETA: 0s - loss: 9.1451 - acc: 0.3992 - ETA: 0s - loss: 9.1587 - acc: 0.3986 - ETA: 0s - loss: 9.1582 - acc: 0.3988 - ETA: 0s - loss: 9.1525 - acc: 0.3991 - ETA: 0s - loss: 9.1647 - acc: 0.3983 - ETA: 0s - loss: 9.1707 - acc: 0.3980 - ETA: 0s - loss: 9.1685 - acc: 0.3982 - ETA: 0s - loss: 9.1646 - acc: 0.3985 - ETA: 0s - loss: 9.1594 - acc: 0.3985Epoch 00004: val_loss did not improve
6680/6680 [==============================] - 8s - loss: 9.1470 - acc: 0.3991 - val_loss: 9.8279 - val_acc: 0.3102
Epoch 6/20
6660/6680 [============================>.] - ETA: 9s - loss: 8.8737 - acc: 0.4500 - ETA: 8s - loss: 8.0055 - acc: 0.4667 - ETA: 8s - loss: 8.6721 - acc: 0.4400 - ETA: 8s - loss: 8.0582 - acc: 0.4786 - ETA: 8s - loss: 8.7068 - acc: 0.4333 - ETA: 8s - loss: 8.7497 - acc: 0.4318 - ETA: 8s - loss: 8.4142 - acc: 0.4462 - ETA: 8s - loss: 8.3225 - acc: 0.4500 - ETA: 8s - loss: 8.4825 - acc: 0.4441 - ETA: 8s - loss: 8.4895 - acc: 0.4447 - ETA: 8s - loss: 8.5637 - acc: 0.4429 - ETA: 7s - loss: 8.5632 - acc: 0.4413 - ETA: 7s - loss: 8.6868 - acc: 0.4340 - ETA: 7s - loss: 8.6420 - acc: 0.4389 - ETA: 7s - loss: 8.6611 - acc: 0.4362 - ETA: 7s - loss: 8.6358 - acc: 0.4371 - ETA: 7s - loss: 8.7049 - acc: 0.4333 - ETA: 7s - loss: 8.6046 - acc: 0.4400 - ETA: 7s - loss: 8.6999 - acc: 0.4324 - ETA: 7s - loss: 8.6934 - acc: 0.4333 - ETA: 7s - loss: 8.7066 - acc: 0.4329 - ETA: 7s - loss: 8.6101 - acc: 0.4384 - ETA: 7s - loss: 8.6829 - acc: 0.4333 - ETA: 7s - loss: 8.7940 - acc: 0.4277 - ETA: 7s - loss: 8.7493 - acc: 0.4306 - ETA: 7s - loss: 8.8014 - acc: 0.4284 - ETA: 7s - loss: 8.8646 - acc: 0.4255 - ETA: 7s - loss: 8.8375 - acc: 0.4273 - ETA: 7s - loss: 8.8546 - acc: 0.4259 - ETA: 7s - loss: 8.7940 - acc: 0.4276 - ETA: 7s - loss: 8.7969 - acc: 0.4283 - ETA: 7s - loss: 8.7863 - acc: 0.4298 - ETA: 7s - loss: 8.7769 - acc: 0.4313 - ETA: 7s - loss: 8.7797 - acc: 0.4318 - ETA: 7s - loss: 8.7908 - acc: 0.4316 - ETA: 7s - loss: 8.7834 - acc: 0.4321 - ETA: 6s - loss: 8.8641 - acc: 0.4278 - ETA: 6s - loss: 8.9080 - acc: 0.4257 - ETA: 6s - loss: 8.9285 - acc: 0.4250 - ETA: 6s - loss: 8.9074 - acc: 0.4263 - ETA: 6s - loss: 8.9165 - acc: 0.4263 - ETA: 6s - loss: 8.9190 - acc: 0.4262 - ETA: 6s - loss: 8.9850 - acc: 0.4226 - ETA: 6s - loss: 8.9916 - acc: 0.4227 - ETA: 6s - loss: 8.9553 - acc: 0.4250 - ETA: 6s - loss: 8.9892 - acc: 0.4233 - ETA: 6s - loss: 8.9717 - acc: 0.4239 - ETA: 6s - loss: 8.9806 - acc: 0.4234 - ETA: 6s - loss: 8.9918 - acc: 0.4224 - ETA: 6s - loss: 8.9993 - acc: 0.4214 - ETA: 6s - loss: 9.0049 - acc: 0.4215 - ETA: 6s - loss: 8.9656 - acc: 0.4240 - ETA: 6s - loss: 8.9797 - acc: 0.4231 - ETA: 6s - loss: 8.9965 - acc: 0.4217 - ETA: 6s - loss: 8.9729 - acc: 0.4227 - ETA: 5s - loss: 8.9709 - acc: 0.4227 - ETA: 5s - loss: 8.9774 - acc: 0.4219 - ETA: 5s - loss: 8.9975 - acc: 0.4206 - ETA: 5s - loss: 9.0163 - acc: 0.4198 - ETA: 5s - loss: 9.0083 - acc: 0.4203 - ETA: 5s - loss: 9.0078 - acc: 0.4204 - ETA: 5s - loss: 8.9855 - acc: 0.4220 - ETA: 5s - loss: 9.0228 - acc: 0.4200 - ETA: 5s - loss: 9.0167 - acc: 0.4201 - ETA: 5s - loss: 9.0090 - acc: 0.4205 - ETA: 5s - loss: 9.0199 - acc: 0.4198 - ETA: 5s - loss: 9.0059 - acc: 0.4211 - ETA: 5s - loss: 8.9836 - acc: 0.4219 - ETA: 5s - loss: 9.0013 - acc: 0.4208 - ETA: 5s - loss: 9.0020 - acc: 0.4205 - ETA: 5s - loss: 9.0101 - acc: 0.4199 - ETA: 5s - loss: 9.0355 - acc: 0.4184 - ETA: 4s - loss: 9.0328 - acc: 0.4182 - ETA: 4s - loss: 9.0150 - acc: 0.4193 - ETA: 4s - loss: 9.0240 - acc: 0.4187 - ETA: 4s - loss: 9.0384 - acc: 0.4178 - ETA: 4s - loss: 9.0475 - acc: 0.4172 - ETA: 4s - loss: 9.0366 - acc: 0.4179 - ETA: 4s - loss: 9.0315 - acc: 0.4177 - ETA: 4s - loss: 9.0257 - acc: 0.4178 - ETA: 4s - loss: 9.0054 - acc: 0.4188 - ETA: 4s - loss: 9.0251 - acc: 0.4174 - ETA: 4s - loss: 9.0151 - acc: 0.4178 - ETA: 4s - loss: 9.0145 - acc: 0.4179 - ETA: 4s - loss: 9.0284 - acc: 0.4171 - ETA: 4s - loss: 9.0234 - acc: 0.4172 - ETA: 4s - loss: 9.0318 - acc: 0.4167 - ETA: 4s - loss: 9.0415 - acc: 0.4159 - ETA: 4s - loss: 9.0534 - acc: 0.4152 - ETA: 4s - loss: 9.0737 - acc: 0.4142 - ETA: 3s - loss: 9.0730 - acc: 0.4137 - ETA: 3s - loss: 9.0709 - acc: 0.4141 - ETA: 3s - loss: 9.0659 - acc: 0.4142 - ETA: 3s - loss: 9.0595 - acc: 0.4149 - ETA: 3s - loss: 9.0547 - acc: 0.4147 - ETA: 3s - loss: 9.0361 - acc: 0.4161 - ETA: 3s - loss: 9.0394 - acc: 0.4160 - ETA: 3s - loss: 9.0483 - acc: 0.4151 - ETA: 3s - loss: 9.0672 - acc: 0.4139 - ETA: 3s - loss: 9.0688 - acc: 0.4138 - ETA: 3s - loss: 9.0593 - acc: 0.4144 - ETA: 3s - loss: 9.0671 - acc: 0.4137 - ETA: 3s - loss: 9.0735 - acc: 0.4133 - ETA: 3s - loss: 9.0835 - acc: 0.4130 - ETA: 3s - loss: 9.0739 - acc: 0.4138 - ETA: 3s - loss: 9.0805 - acc: 0.4134 - ETA: 3s - loss: 9.0920 - acc: 0.4129 - ETA: 3s - loss: 9.0939 - acc: 0.4127 - ETA: 3s - loss: 9.0923 - acc: 0.4128 - ETA: 2s - loss: 9.0834 - acc: 0.4134 - ETA: 2s - loss: 9.0889 - acc: 0.4133 - ETA: 2s - loss: 9.1033 - acc: 0.4123 - ETA: 2s - loss: 9.1156 - acc: 0.4115 - ETA: 2s - loss: 9.1172 - acc: 0.4114 - ETA: 2s - loss: 9.1024 - acc: 0.4122 - ETA: 2s - loss: 9.1039 - acc: 0.4123 - ETA: 2s - loss: 9.0992 - acc: 0.4122 - ETA: 2s - loss: 9.1011 - acc: 0.4121 - ETA: 2s - loss: 9.1027 - acc: 0.4122 - ETA: 2s - loss: 9.1017 - acc: 0.4123 - ETA: 2s - loss: 9.1148 - acc: 0.4114 - ETA: 2s - loss: 9.0972 - acc: 0.4123 - ETA: 2s - loss: 9.1064 - acc: 0.4116 - ETA: 2s - loss: 9.0868 - acc: 0.4127 - ETA: 2s - loss: 9.0923 - acc: 0.4124 - ETA: 2s - loss: 9.0854 - acc: 0.4127 - ETA: 2s - loss: 9.0808 - acc: 0.4130 - ETA: 2s - loss: 9.0744 - acc: 0.4135 - ETA: 1s - loss: 9.0694 - acc: 0.4137 - ETA: 1s - loss: 9.0494 - acc: 0.4151 - ETA: 1s - loss: 9.0572 - acc: 0.4148 - ETA: 1s - loss: 9.0470 - acc: 0.4155 - ETA: 1s - loss: 9.0577 - acc: 0.4148 - ETA: 1s - loss: 9.0448 - acc: 0.4156 - ETA: 1s - loss: 9.0369 - acc: 0.4162 - ETA: 1s - loss: 9.0367 - acc: 0.4163 - ETA: 1s - loss: 9.0330 - acc: 0.4164 - ETA: 1s - loss: 9.0485 - acc: 0.4155 - ETA: 1s - loss: 9.0539 - acc: 0.4152 - ETA: 1s - loss: 9.0554 - acc: 0.4153 - ETA: 1s - loss: 9.0562 - acc: 0.4154 - ETA: 1s - loss: 9.0608 - acc: 0.4151 - ETA: 1s - loss: 9.0686 - acc: 0.4146 - ETA: 1s - loss: 9.0535 - acc: 0.4154 - ETA: 1s - loss: 9.0606 - acc: 0.4148 - ETA: 1s - loss: 9.0546 - acc: 0.4145 - ETA: 1s - loss: 9.0548 - acc: 0.4146 - ETA: 0s - loss: 9.0521 - acc: 0.4146 - ETA: 0s - loss: 9.0624 - acc: 0.4139 - ETA: 0s - loss: 9.0736 - acc: 0.4134 - ETA: 0s - loss: 9.0839 - acc: 0.4127 - ETA: 0s - loss: 9.0984 - acc: 0.4118 - ETA: 0s - loss: 9.0907 - acc: 0.4123 - ETA: 0s - loss: 9.0716 - acc: 0.4135 - ETA: 0s - loss: 9.0734 - acc: 0.4133 - ETA: 0s - loss: 9.0811 - acc: 0.4127 - ETA: 0s - loss: 9.0703 - acc: 0.4132 - ETA: 0s - loss: 9.0678 - acc: 0.4132 - ETA: 0s - loss: 9.0722 - acc: 0.4129 - ETA: 0s - loss: 9.0810 - acc: 0.4125 - ETA: 0s - loss: 9.0821 - acc: 0.4121 - ETA: 0s - loss: 9.0772 - acc: 0.4123 - ETA: 0s - loss: 9.0860 - acc: 0.4118 - ETA: 0s - loss: 9.0964 - acc: 0.4111Epoch 00005: val_loss improved from 9.75539 to 9.60554, saving model to saved_models/weights.best.VGG16.hdf5
6680/6680 [==============================] - 9s - loss: 9.0944 - acc: 0.4111 - val_loss: 9.6055 - val_acc: 0.3246
Epoch 7/20
6640/6680 [============================>.] - ETA: 6s - loss: 10.4873 - acc: 0.3500 - ETA: 6s - loss: 9.0993 - acc: 0.4250  - ETA: 7s - loss: 8.1091 - acc: 0.4833 - ETA: 7s - loss: 8.3810 - acc: 0.4688 - ETA: 7s - loss: 8.4854 - acc: 0.4600 - ETA: 7s - loss: 8.6160 - acc: 0.4542 - ETA: 7s - loss: 8.4335 - acc: 0.4607 - ETA: 7s - loss: 8.3627 - acc: 0.4656 - ETA: 7s - loss: 8.4285 - acc: 0.4611 - ETA: 7s - loss: 8.3225 - acc: 0.4675 - ETA: 7s - loss: 8.3776 - acc: 0.4636 - ETA: 7s - loss: 8.4916 - acc: 0.4542 - ETA: 7s - loss: 8.3976 - acc: 0.4615 - ETA: 7s - loss: 8.5142 - acc: 0.4518 - ETA: 7s - loss: 8.5376 - acc: 0.4517 - ETA: 7s - loss: 8.4944 - acc: 0.4547 - ETA: 7s - loss: 8.5875 - acc: 0.4500 - ETA: 7s - loss: 8.4255 - acc: 0.4611 - ETA: 7s - loss: 8.4275 - acc: 0.4618 - ETA: 7s - loss: 8.5300 - acc: 0.4563 - ETA: 7s - loss: 8.6036 - acc: 0.4524 - ETA: 7s - loss: 8.6049 - acc: 0.4511 - ETA: 7s - loss: 8.6704 - acc: 0.4467 - ETA: 7s - loss: 8.6119 - acc: 0.4510 - ETA: 7s - loss: 8.6866 - acc: 0.4470 - ETA: 6s - loss: 8.7165 - acc: 0.4434 - ETA: 6s - loss: 8.7530 - acc: 0.4409 - ETA: 6s - loss: 8.8290 - acc: 0.4368 - ETA: 6s - loss: 8.9009 - acc: 0.4322 - ETA: 6s - loss: 8.8823 - acc: 0.4336 - ETA: 6s - loss: 8.9330 - acc: 0.4310 - ETA: 6s - loss: 8.9199 - acc: 0.4315 - ETA: 6s - loss: 8.9343 - acc: 0.4306 - ETA: 6s - loss: 8.9129 - acc: 0.4312 - ETA: 6s - loss: 8.8561 - acc: 0.4338 - ETA: 6s - loss: 8.8485 - acc: 0.4329 - ETA: 6s - loss: 8.8513 - acc: 0.4327 - ETA: 6s - loss: 8.8296 - acc: 0.4333 - ETA: 6s - loss: 8.8215 - acc: 0.4338 - ETA: 6s - loss: 8.8822 - acc: 0.4305 - ETA: 6s - loss: 8.8747 - acc: 0.4310 - ETA: 6s - loss: 8.8879 - acc: 0.4297 - ETA: 6s - loss: 8.8883 - acc: 0.4295 - ETA: 6s - loss: 8.9157 - acc: 0.4278 - ETA: 6s - loss: 8.9155 - acc: 0.4277 - ETA: 6s - loss: 8.9511 - acc: 0.4255 - ETA: 6s - loss: 8.9524 - acc: 0.4250 - ETA: 5s - loss: 8.9591 - acc: 0.4250 - ETA: 5s - loss: 8.9572 - acc: 0.4255 - ETA: 5s - loss: 8.9718 - acc: 0.4250 - ETA: 5s - loss: 8.9544 - acc: 0.4264 - ETA: 5s - loss: 8.9455 - acc: 0.4274 - ETA: 5s - loss: 8.9270 - acc: 0.4273 - ETA: 5s - loss: 8.9265 - acc: 0.4273 - ETA: 5s - loss: 8.9223 - acc: 0.4272 - ETA: 5s - loss: 8.9306 - acc: 0.4268 - ETA: 5s - loss: 8.9381 - acc: 0.4259 - ETA: 5s - loss: 8.9915 - acc: 0.4229 - ETA: 5s - loss: 8.9915 - acc: 0.4221 - ETA: 5s - loss: 8.9969 - acc: 0.4213 - ETA: 5s - loss: 8.9883 - acc: 0.4222 - ETA: 5s - loss: 9.0212 - acc: 0.4202 - ETA: 5s - loss: 9.0126 - acc: 0.4211 - ETA: 5s - loss: 9.0244 - acc: 0.4204 - ETA: 5s - loss: 9.0217 - acc: 0.4207 - ETA: 5s - loss: 9.0436 - acc: 0.4193 - ETA: 4s - loss: 9.0729 - acc: 0.4175 - ETA: 4s - loss: 9.0643 - acc: 0.4183 - ETA: 4s - loss: 9.0631 - acc: 0.4177 - ETA: 4s - loss: 9.0496 - acc: 0.4185 - ETA: 4s - loss: 9.0443 - acc: 0.4190 - ETA: 4s - loss: 9.0529 - acc: 0.4187 - ETA: 4s - loss: 9.0720 - acc: 0.4178 - ETA: 4s - loss: 9.0472 - acc: 0.4191 - ETA: 4s - loss: 9.0466 - acc: 0.4188 - ETA: 4s - loss: 9.0547 - acc: 0.4186 - ETA: 4s - loss: 9.0290 - acc: 0.4198 - ETA: 4s - loss: 9.0622 - acc: 0.4180 - ETA: 4s - loss: 9.0418 - acc: 0.4193 - ETA: 4s - loss: 9.0399 - acc: 0.4197 - ETA: 4s - loss: 9.0433 - acc: 0.4195 - ETA: 4s - loss: 9.0428 - acc: 0.4195 - ETA: 4s - loss: 9.0224 - acc: 0.4208 - ETA: 4s - loss: 9.0091 - acc: 0.4217 - ETA: 3s - loss: 9.0174 - acc: 0.4211 - ETA: 3s - loss: 9.0105 - acc: 0.4213 - ETA: 3s - loss: 8.9976 - acc: 0.4222 - ETA: 3s - loss: 9.0214 - acc: 0.4209 - ETA: 3s - loss: 8.9997 - acc: 0.4223 - ETA: 3s - loss: 9.0044 - acc: 0.4220 - ETA: 3s - loss: 8.9897 - acc: 0.4218 - ETA: 3s - loss: 8.9942 - acc: 0.4217 - ETA: 3s - loss: 8.9974 - acc: 0.4215 - ETA: 3s - loss: 9.0156 - acc: 0.4203 - ETA: 3s - loss: 9.0088 - acc: 0.4206 - ETA: 3s - loss: 9.0064 - acc: 0.4209 - ETA: 3s - loss: 9.0099 - acc: 0.4206 - ETA: 3s - loss: 8.9925 - acc: 0.4217 - ETA: 3s - loss: 8.9840 - acc: 0.4218 - ETA: 3s - loss: 8.9757 - acc: 0.4224 - ETA: 3s - loss: 8.9703 - acc: 0.4224 - ETA: 3s - loss: 8.9903 - acc: 0.4208 - ETA: 2s - loss: 8.9938 - acc: 0.4206 - ETA: 2s - loss: 8.9833 - acc: 0.4211 - ETA: 2s - loss: 8.9884 - acc: 0.4206 - ETA: 2s - loss: 9.0003 - acc: 0.4197 - ETA: 2s - loss: 8.9812 - acc: 0.4211 - ETA: 2s - loss: 8.9916 - acc: 0.4202 - ETA: 2s - loss: 9.0087 - acc: 0.4192 - ETA: 2s - loss: 9.0040 - acc: 0.4197 - ETA: 2s - loss: 8.9900 - acc: 0.4206 - ETA: 2s - loss: 8.9788 - acc: 0.4214 - ETA: 2s - loss: 8.9889 - acc: 0.4208 - ETA: 2s - loss: 8.9860 - acc: 0.4210 - ETA: 2s - loss: 8.9855 - acc: 0.4210 - ETA: 2s - loss: 8.9748 - acc: 0.4217 - ETA: 2s - loss: 8.9715 - acc: 0.4217 - ETA: 2s - loss: 8.9599 - acc: 0.4220 - ETA: 2s - loss: 8.9657 - acc: 0.4218 - ETA: 2s - loss: 8.9639 - acc: 0.4216 - ETA: 2s - loss: 8.9651 - acc: 0.4214 - ETA: 1s - loss: 8.9628 - acc: 0.4215 - ETA: 1s - loss: 8.9657 - acc: 0.4213 - ETA: 1s - loss: 8.9807 - acc: 0.4205 - ETA: 1s - loss: 8.9844 - acc: 0.4200 - ETA: 1s - loss: 8.9813 - acc: 0.4202 - ETA: 1s - loss: 8.9737 - acc: 0.4206 - ETA: 1s - loss: 8.9718 - acc: 0.4208 - ETA: 1s - loss: 8.9741 - acc: 0.4201 - ETA: 1s - loss: 8.9800 - acc: 0.4197 - ETA: 1s - loss: 8.9826 - acc: 0.4196 - ETA: 1s - loss: 8.9885 - acc: 0.4193 - ETA: 1s - loss: 8.9837 - acc: 0.4195 - ETA: 1s - loss: 8.9989 - acc: 0.4185 - ETA: 1s - loss: 8.9980 - acc: 0.4187 - ETA: 1s - loss: 8.9971 - acc: 0.4189 - ETA: 1s - loss: 8.9968 - acc: 0.4188 - ETA: 1s - loss: 8.9875 - acc: 0.4195 - ETA: 1s - loss: 8.9951 - acc: 0.4192 - ETA: 1s - loss: 8.9898 - acc: 0.4196 - ETA: 1s - loss: 8.9836 - acc: 0.4201 - ETA: 0s - loss: 8.9885 - acc: 0.4200 - ETA: 0s - loss: 8.9856 - acc: 0.4199 - ETA: 0s - loss: 8.9782 - acc: 0.4202 - ETA: 0s - loss: 8.9629 - acc: 0.4211 - ETA: 0s - loss: 8.9632 - acc: 0.4208 - ETA: 0s - loss: 8.9686 - acc: 0.4205 - ETA: 0s - loss: 8.9630 - acc: 0.4208 - ETA: 0s - loss: 8.9537 - acc: 0.4211 - ETA: 0s - loss: 8.9584 - acc: 0.4210 - ETA: 0s - loss: 8.9556 - acc: 0.4212 - ETA: 0s - loss: 8.9463 - acc: 0.4218 - ETA: 0s - loss: 8.9489 - acc: 0.4217 - ETA: 0s - loss: 8.9401 - acc: 0.4223 - ETA: 0s - loss: 8.9302 - acc: 0.4228 - ETA: 0s - loss: 8.9203 - acc: 0.4235 - ETA: 0s - loss: 8.9364 - acc: 0.4222 - ETA: 0s - loss: 8.9340 - acc: 0.4224 - ETA: 0s - loss: 8.9388 - acc: 0.4221 - ETA: 0s - loss: 8.9349 - acc: 0.4220Epoch 00006: val_loss improved from 9.60554 to 9.46046, saving model to saved_models/weights.best.VGG16.hdf5
6680/6680 [==============================] - 8s - loss: 8.9491 - acc: 0.4211 - val_loss: 9.4605 - val_acc: 0.3389
Epoch 8/20
6660/6680 [============================>.] - ETA: 6s - loss: 7.2750 - acc: 0.5500 - ETA: 7s - loss: 9.4205 - acc: 0.4167 - ETA: 7s - loss: 9.0418 - acc: 0.4400 - ETA: 7s - loss: 8.7362 - acc: 0.4500 - ETA: 7s - loss: 9.2174 - acc: 0.4222 - ETA: 7s - loss: 9.4650 - acc: 0.4042 - ETA: 7s - loss: 9.2661 - acc: 0.4179 - ETA: 7s - loss: 8.8803 - acc: 0.4406 - ETA: 7s - loss: 8.8422 - acc: 0.4417 - ETA: 7s - loss: 8.8854 - acc: 0.4400 - ETA: 7s - loss: 8.7388 - acc: 0.4500 - ETA: 7s - loss: 8.6825 - acc: 0.4542 - ETA: 7s - loss: 8.6758 - acc: 0.4537 - ETA: 7s - loss: 8.6174 - acc: 0.4534 - ETA: 7s - loss: 8.5300 - acc: 0.4597 - ETA: 7s - loss: 8.4627 - acc: 0.4636 - ETA: 7s - loss: 8.4964 - acc: 0.4614 - ETA: 7s - loss: 8.4340 - acc: 0.4649 - ETA: 7s - loss: 8.4167 - acc: 0.4654 - ETA: 7s - loss: 8.3403 - acc: 0.4707 - ETA: 7s - loss: 8.4031 - acc: 0.4674 - ETA: 7s - loss: 8.4505 - acc: 0.4633 - ETA: 7s - loss: 8.5539 - acc: 0.4574 - ETA: 7s - loss: 8.5834 - acc: 0.4561 - ETA: 7s - loss: 8.6296 - acc: 0.4529 - ETA: 7s - loss: 8.6586 - acc: 0.4509 - ETA: 7s - loss: 8.6545 - acc: 0.4509 - ETA: 7s - loss: 8.6227 - acc: 0.4526 - ETA: 7s - loss: 8.6173 - acc: 0.4534 - ETA: 6s - loss: 8.6270 - acc: 0.4525 - ETA: 6s - loss: 8.5872 - acc: 0.4548 - ETA: 6s - loss: 8.5839 - acc: 0.4554 - ETA: 6s - loss: 8.5806 - acc: 0.4560 - ETA: 6s - loss: 8.5843 - acc: 0.4543 - ETA: 6s - loss: 8.5835 - acc: 0.4535 - ETA: 6s - loss: 8.4845 - acc: 0.4582 - ETA: 6s - loss: 8.5269 - acc: 0.4560 - ETA: 6s - loss: 8.5255 - acc: 0.4565 - ETA: 6s - loss: 8.5540 - acc: 0.4551 - ETA: 6s - loss: 8.5618 - acc: 0.4549 - ETA: 6s - loss: 8.5607 - acc: 0.4548 - ETA: 6s - loss: 8.5864 - acc: 0.4529 - ETA: 6s - loss: 8.5983 - acc: 0.4517 - ETA: 6s - loss: 8.5683 - acc: 0.4539 - ETA: 6s - loss: 8.5844 - acc: 0.4527 - ETA: 6s - loss: 8.6339 - acc: 0.4500 - ETA: 6s - loss: 8.6049 - acc: 0.4521 - ETA: 6s - loss: 8.6192 - acc: 0.4515 - ETA: 5s - loss: 8.6768 - acc: 0.4480 - ETA: 5s - loss: 8.6507 - acc: 0.4490 - ETA: 5s - loss: 8.6392 - acc: 0.4500 - ETA: 5s - loss: 8.6391 - acc: 0.4500 - ETA: 5s - loss: 8.6221 - acc: 0.4509 - ETA: 5s - loss: 8.5903 - acc: 0.4528 - ETA: 5s - loss: 8.5688 - acc: 0.4536 - ETA: 5s - loss: 8.5802 - acc: 0.4522 - ETA: 5s - loss: 8.5736 - acc: 0.4522 - ETA: 5s - loss: 8.5325 - acc: 0.4547 - ETA: 5s - loss: 8.5517 - acc: 0.4538 - ETA: 5s - loss: 8.5577 - acc: 0.4533 - ETA: 5s - loss: 8.5759 - acc: 0.4524 - ETA: 5s - loss: 8.5831 - acc: 0.4512 - ETA: 5s - loss: 8.6066 - acc: 0.4500 - ETA: 5s - loss: 8.6116 - acc: 0.4492 - ETA: 5s - loss: 8.6251 - acc: 0.4485 - ETA: 5s - loss: 8.6331 - acc: 0.4477 - ETA: 5s - loss: 8.6665 - acc: 0.4459 - ETA: 5s - loss: 8.6707 - acc: 0.4453 - ETA: 5s - loss: 8.6242 - acc: 0.4482 - ETA: 4s - loss: 8.6130 - acc: 0.4486 - ETA: 4s - loss: 8.6579 - acc: 0.4458 - ETA: 4s - loss: 8.6829 - acc: 0.4445 - ETA: 4s - loss: 8.6695 - acc: 0.4453 - ETA: 4s - loss: 8.6775 - acc: 0.4450 - ETA: 4s - loss: 8.6707 - acc: 0.4451 - ETA: 4s - loss: 8.6837 - acc: 0.4445 - ETA: 4s - loss: 8.7017 - acc: 0.4436 - ETA: 4s - loss: 8.7094 - acc: 0.4430 - ETA: 4s - loss: 8.6766 - acc: 0.4450 - ETA: 4s - loss: 8.6798 - acc: 0.4448 - ETA: 4s - loss: 8.6841 - acc: 0.4445 - ETA: 4s - loss: 8.6740 - acc: 0.4452 - ETA: 4s - loss: 8.6765 - acc: 0.4449 - ETA: 4s - loss: 8.6562 - acc: 0.4459 - ETA: 4s - loss: 8.6801 - acc: 0.4439 - ETA: 4s - loss: 8.6730 - acc: 0.4445 - ETA: 4s - loss: 8.6815 - acc: 0.4444 - ETA: 3s - loss: 8.6574 - acc: 0.4458 - ETA: 3s - loss: 8.6508 - acc: 0.4464 - ETA: 3s - loss: 8.6729 - acc: 0.4448 - ETA: 3s - loss: 8.6766 - acc: 0.4444 - ETA: 3s - loss: 8.6873 - acc: 0.4439 - ETA: 3s - loss: 8.6848 - acc: 0.4442 - ETA: 3s - loss: 8.6868 - acc: 0.4443 - ETA: 3s - loss: 8.6859 - acc: 0.4443 - ETA: 3s - loss: 8.6794 - acc: 0.4442 - ETA: 3s - loss: 8.6613 - acc: 0.4455 - ETA: 3s - loss: 8.6874 - acc: 0.4440 - ETA: 3s - loss: 8.6744 - acc: 0.4448 - ETA: 3s - loss: 8.6802 - acc: 0.4446 - ETA: 3s - loss: 8.7093 - acc: 0.4430 - ETA: 3s - loss: 8.7125 - acc: 0.4428 - ETA: 3s - loss: 8.7141 - acc: 0.4429 - ETA: 3s - loss: 8.7404 - acc: 0.4413 - ETA: 3s - loss: 8.7304 - acc: 0.4421 - ETA: 2s - loss: 8.7449 - acc: 0.4412 - ETA: 2s - loss: 8.7402 - acc: 0.4413 - ETA: 2s - loss: 8.7276 - acc: 0.4423 - ETA: 2s - loss: 8.7294 - acc: 0.4420 - ETA: 2s - loss: 8.7140 - acc: 0.4427 - ETA: 2s - loss: 8.7016 - acc: 0.4434 - ETA: 2s - loss: 8.7049 - acc: 0.4430 - ETA: 2s - loss: 8.6939 - acc: 0.4435 - ETA: 2s - loss: 8.6818 - acc: 0.4444 - ETA: 2s - loss: 8.6919 - acc: 0.4439 - ETA: 2s - loss: 8.7071 - acc: 0.4431 - ETA: 2s - loss: 8.7175 - acc: 0.4425 - ETA: 2s - loss: 8.7078 - acc: 0.4430 - ETA: 2s - loss: 8.7058 - acc: 0.4432 - ETA: 2s - loss: 8.7006 - acc: 0.4437 - ETA: 2s - loss: 8.7151 - acc: 0.4429 - ETA: 2s - loss: 8.7133 - acc: 0.4430 - ETA: 2s - loss: 8.7306 - acc: 0.4421 - ETA: 2s - loss: 8.7259 - acc: 0.4421 - ETA: 2s - loss: 8.7255 - acc: 0.4422 - ETA: 1s - loss: 8.7302 - acc: 0.4416 - ETA: 1s - loss: 8.7380 - acc: 0.4411 - ETA: 1s - loss: 8.7378 - acc: 0.4410 - ETA: 1s - loss: 8.7387 - acc: 0.4411 - ETA: 1s - loss: 8.7339 - acc: 0.4413 - ETA: 1s - loss: 8.7382 - acc: 0.4410 - ETA: 1s - loss: 8.7431 - acc: 0.4407 - ETA: 1s - loss: 8.7400 - acc: 0.4408 - ETA: 1s - loss: 8.7528 - acc: 0.4401 - ETA: 1s - loss: 8.7529 - acc: 0.4400 - ETA: 1s - loss: 8.7508 - acc: 0.4403 - ETA: 1s - loss: 8.7661 - acc: 0.4394 - ETA: 1s - loss: 8.7672 - acc: 0.4393 - ETA: 1s - loss: 8.7629 - acc: 0.4396 - ETA: 1s - loss: 8.7755 - acc: 0.4388 - ETA: 1s - loss: 8.7817 - acc: 0.4385 - ETA: 1s - loss: 8.7907 - acc: 0.4381 - ETA: 1s - loss: 8.7969 - acc: 0.4378 - ETA: 1s - loss: 8.8081 - acc: 0.4372 - ETA: 1s - loss: 8.8103 - acc: 0.4369 - ETA: 0s - loss: 8.7945 - acc: 0.4380 - ETA: 0s - loss: 8.7924 - acc: 0.4383 - ETA: 0s - loss: 8.8037 - acc: 0.4377 - ETA: 0s - loss: 8.8257 - acc: 0.4363 - ETA: 0s - loss: 8.8332 - acc: 0.4355 - ETA: 0s - loss: 8.8362 - acc: 0.4353 - ETA: 0s - loss: 8.8391 - acc: 0.4352 - ETA: 0s - loss: 8.8390 - acc: 0.4348 - ETA: 0s - loss: 8.8438 - acc: 0.4341 - ETA: 0s - loss: 8.8420 - acc: 0.4342 - ETA: 0s - loss: 8.8500 - acc: 0.4339 - ETA: 0s - loss: 8.8526 - acc: 0.4338 - ETA: 0s - loss: 8.8505 - acc: 0.4339 - ETA: 0s - loss: 8.8320 - acc: 0.4347 - ETA: 0s - loss: 8.8286 - acc: 0.4348 - ETA: 0s - loss: 8.8217 - acc: 0.4351 - ETA: 0s - loss: 8.8269 - acc: 0.4349 - ETA: 0s - loss: 8.8371 - acc: 0.4343 - ETA: 0s - loss: 8.8548 - acc: 0.4332 - ETA: 0s - loss: 8.8435 - acc: 0.4338Epoch 00007: val_loss did not improve
6680/6680 [==============================] - 9s - loss: 8.8465 - acc: 0.4335 - val_loss: 9.4716 - val_acc: 0.3413
Epoch 9/20
6640/6680 [============================>.] - ETA: 3s - loss: 8.8802 - acc: 0.4500 - ETA: 7s - loss: 9.4287 - acc: 0.4000 - ETA: 8s - loss: 9.5434 - acc: 0.3900 - ETA: 8s - loss: 9.7067 - acc: 0.3786 - ETA: 9s - loss: 8.9088 - acc: 0.4222 - ETA: 8s - loss: 8.6094 - acc: 0.4455 - ETA: 8s - loss: 8.6522 - acc: 0.4423 - ETA: 8s - loss: 8.5733 - acc: 0.4500 - ETA: 8s - loss: 8.7983 - acc: 0.4382 - ETA: 8s - loss: 8.8902 - acc: 0.4342 - ETA: 9s - loss: 9.0501 - acc: 0.4250 - ETA: 9s - loss: 9.0416 - acc: 0.4250 - ETA: 9s - loss: 9.1612 - acc: 0.4188 - ETA: 9s - loss: 9.1385 - acc: 0.4212 - ETA: 9s - loss: 9.1543 - acc: 0.4196 - ETA: 9s - loss: 9.0561 - acc: 0.4267 - ETA: 9s - loss: 9.0486 - acc: 0.4266 - ETA: 9s - loss: 8.9431 - acc: 0.4338 - ETA: 8s - loss: 8.8421 - acc: 0.4375 - ETA: 8s - loss: 8.7814 - acc: 0.4421 - ETA: 8s - loss: 8.7857 - acc: 0.4425 - ETA: 8s - loss: 8.7707 - acc: 0.4440 - ETA: 8s - loss: 8.8299 - acc: 0.4409 - ETA: 8s - loss: 8.7298 - acc: 0.4467 - ETA: 8s - loss: 8.6861 - acc: 0.4500 - ETA: 8s - loss: 8.6136 - acc: 0.4540 - ETA: 8s - loss: 8.6289 - acc: 0.4529 - ETA: 8s - loss: 8.6750 - acc: 0.4500 - ETA: 8s - loss: 8.6880 - acc: 0.4491 - ETA: 8s - loss: 8.6537 - acc: 0.4509 - ETA: 7s - loss: 8.6748 - acc: 0.4500 - ETA: 7s - loss: 8.7592 - acc: 0.4452 - ETA: 7s - loss: 8.6748 - acc: 0.4508 - ETA: 7s - loss: 8.7078 - acc: 0.4485 - ETA: 7s - loss: 8.7885 - acc: 0.4434 - ETA: 7s - loss: 8.8368 - acc: 0.4407 - ETA: 7s - loss: 8.8272 - acc: 0.4410 - ETA: 7s - loss: 8.8719 - acc: 0.4385 - ETA: 7s - loss: 8.9170 - acc: 0.4355 - ETA: 7s - loss: 8.9061 - acc: 0.4365 - ETA: 7s - loss: 8.8565 - acc: 0.4394 - ETA: 7s - loss: 8.8475 - acc: 0.4402 - ETA: 7s - loss: 8.8768 - acc: 0.4387 - ETA: 7s - loss: 8.8953 - acc: 0.4378 - ETA: 6s - loss: 8.8675 - acc: 0.4398 - ETA: 6s - loss: 8.8586 - acc: 0.4406 - ETA: 6s - loss: 8.8325 - acc: 0.4424 - ETA: 6s - loss: 8.7908 - acc: 0.4447 - ETA: 6s - loss: 8.7672 - acc: 0.4464 - ETA: 6s - loss: 8.7284 - acc: 0.4490 - ETA: 6s - loss: 8.7186 - acc: 0.4495 - ETA: 6s - loss: 8.7453 - acc: 0.4480 - ETA: 6s - loss: 8.7786 - acc: 0.4462 - ETA: 6s - loss: 8.8335 - acc: 0.4429 - ETA: 6s - loss: 8.8865 - acc: 0.4398 - ETA: 6s - loss: 8.8369 - acc: 0.4427 - ETA: 6s - loss: 8.8114 - acc: 0.4433 - ETA: 6s - loss: 8.7913 - acc: 0.4447 - ETA: 6s - loss: 8.7787 - acc: 0.4457 - ETA: 6s - loss: 8.7553 - acc: 0.4470 - ETA: 5s - loss: 8.7598 - acc: 0.4463 - ETA: 5s - loss: 8.7515 - acc: 0.4467 - ETA: 5s - loss: 8.7663 - acc: 0.4460 - ETA: 5s - loss: 8.7902 - acc: 0.4444 - ETA: 5s - loss: 8.7789 - acc: 0.4453 - ETA: 5s - loss: 8.7948 - acc: 0.4442 - ETA: 5s - loss: 8.7792 - acc: 0.4451 - ETA: 5s - loss: 8.7364 - acc: 0.4474 - ETA: 5s - loss: 8.7326 - acc: 0.4478 - ETA: 5s - loss: 8.7412 - acc: 0.4471 - ETA: 5s - loss: 8.7202 - acc: 0.4486 - ETA: 5s - loss: 8.7236 - acc: 0.4482 - ETA: 5s - loss: 8.7311 - acc: 0.4479 - ETA: 5s - loss: 8.7220 - acc: 0.4486 - ETA: 5s - loss: 8.7352 - acc: 0.4476 - ETA: 5s - loss: 8.7638 - acc: 0.4460 - ETA: 4s - loss: 8.7349 - acc: 0.4477 - ETA: 4s - loss: 8.7421 - acc: 0.4474 - ETA: 4s - loss: 8.7695 - acc: 0.4458 - ETA: 4s - loss: 8.7860 - acc: 0.4449 - ETA: 4s - loss: 8.7896 - acc: 0.4447 - ETA: 4s - loss: 8.7657 - acc: 0.4463 - ETA: 4s - loss: 8.7648 - acc: 0.4451 - ETA: 4s - loss: 8.7661 - acc: 0.4452 - ETA: 4s - loss: 8.7433 - acc: 0.4467 - ETA: 4s - loss: 8.7213 - acc: 0.4482 - ETA: 4s - loss: 8.7153 - acc: 0.4483 - ETA: 4s - loss: 8.7217 - acc: 0.4480 - ETA: 4s - loss: 8.7233 - acc: 0.4480 - ETA: 4s - loss: 8.7252 - acc: 0.4478 - ETA: 4s - loss: 8.7358 - acc: 0.4472 - ETA: 4s - loss: 8.7330 - acc: 0.4475 - ETA: 4s - loss: 8.7258 - acc: 0.4481 - ETA: 4s - loss: 8.7327 - acc: 0.4476 - ETA: 3s - loss: 8.7390 - acc: 0.4471 - ETA: 3s - loss: 8.7619 - acc: 0.4455 - ETA: 3s - loss: 8.7565 - acc: 0.4456 - ETA: 3s - loss: 8.7702 - acc: 0.4448 - ETA: 3s - loss: 8.7754 - acc: 0.4446 - ETA: 3s - loss: 8.7886 - acc: 0.4439 - ETA: 3s - loss: 8.7975 - acc: 0.4435 - ETA: 3s - loss: 8.7862 - acc: 0.4443 - ETA: 3s - loss: 8.7950 - acc: 0.4439 - ETA: 3s - loss: 8.7918 - acc: 0.4442 - ETA: 3s - loss: 8.8119 - acc: 0.4430 - ETA: 3s - loss: 8.8204 - acc: 0.4424 - ETA: 3s - loss: 8.8171 - acc: 0.4427 - ETA: 3s - loss: 8.8067 - acc: 0.4435 - ETA: 3s - loss: 8.8233 - acc: 0.4424 - ETA: 3s - loss: 8.8277 - acc: 0.4420 - ETA: 3s - loss: 8.8098 - acc: 0.4432 - ETA: 3s - loss: 8.7963 - acc: 0.4439 - ETA: 2s - loss: 8.8024 - acc: 0.4433 - ETA: 2s - loss: 8.7923 - acc: 0.4441 - ETA: 2s - loss: 8.7900 - acc: 0.4441 - ETA: 2s - loss: 8.7907 - acc: 0.4442 - ETA: 2s - loss: 8.7883 - acc: 0.4444 - ETA: 2s - loss: 8.7890 - acc: 0.4445 - ETA: 2s - loss: 8.7863 - acc: 0.4447 - ETA: 2s - loss: 8.7914 - acc: 0.4444 - ETA: 2s - loss: 8.7839 - acc: 0.4448 - ETA: 2s - loss: 8.7681 - acc: 0.4459 - ETA: 2s - loss: 8.7828 - acc: 0.4449 - ETA: 2s - loss: 8.8063 - acc: 0.4435 - ETA: 2s - loss: 8.8041 - acc: 0.4436 - ETA: 2s - loss: 8.7952 - acc: 0.4442 - ETA: 2s - loss: 8.8117 - acc: 0.4433 - ETA: 2s - loss: 8.7946 - acc: 0.4441 - ETA: 2s - loss: 8.7860 - acc: 0.4448 - ETA: 1s - loss: 8.7840 - acc: 0.4448 - ETA: 1s - loss: 8.7817 - acc: 0.4450 - ETA: 1s - loss: 8.7858 - acc: 0.4447 - ETA: 1s - loss: 8.7939 - acc: 0.4440 - ETA: 1s - loss: 8.7914 - acc: 0.4442 - ETA: 1s - loss: 8.7800 - acc: 0.4450 - ETA: 1s - loss: 8.7748 - acc: 0.4454 - ETA: 1s - loss: 8.7755 - acc: 0.4454 - ETA: 1s - loss: 8.7766 - acc: 0.4453 - ETA: 1s - loss: 8.7778 - acc: 0.4450 - ETA: 1s - loss: 8.7871 - acc: 0.4445 - ETA: 1s - loss: 8.7910 - acc: 0.4441 - ETA: 1s - loss: 8.8005 - acc: 0.4433 - ETA: 1s - loss: 8.8125 - acc: 0.4425 - ETA: 1s - loss: 8.8045 - acc: 0.4431 - ETA: 1s - loss: 8.8216 - acc: 0.4421 - ETA: 1s - loss: 8.8194 - acc: 0.4423 - ETA: 1s - loss: 8.8115 - acc: 0.4429 - ETA: 1s - loss: 8.8072 - acc: 0.4429 - ETA: 0s - loss: 8.8239 - acc: 0.4419 - ETA: 0s - loss: 8.8273 - acc: 0.4417 - ETA: 0s - loss: 8.8176 - acc: 0.4421 - ETA: 0s - loss: 8.8189 - acc: 0.4418 - ETA: 0s - loss: 8.8092 - acc: 0.4424 - ETA: 0s - loss: 8.8124 - acc: 0.4421 - ETA: 0s - loss: 8.8102 - acc: 0.4423 - ETA: 0s - loss: 8.8031 - acc: 0.4428 - ETA: 0s - loss: 8.7963 - acc: 0.4432 - ETA: 0s - loss: 8.8069 - acc: 0.4426 - ETA: 0s - loss: 8.8174 - acc: 0.4420 - ETA: 0s - loss: 8.8208 - acc: 0.4418 - ETA: 0s - loss: 8.8136 - acc: 0.4423 - ETA: 0s - loss: 8.7992 - acc: 0.4433 - ETA: 0s - loss: 8.8022 - acc: 0.4430 - ETA: 0s - loss: 8.8026 - acc: 0.4430 - ETA: 0s - loss: 8.8055 - acc: 0.4429Epoch 00008: val_loss did not improve
6680/6680 [==============================] - 9s - loss: 8.7991 - acc: 0.4433 - val_loss: 9.5017 - val_acc: 0.3449
Epoch 10/20
6660/6680 [============================>.] - ETA: 6s - loss: 5.7143 - acc: 0.6000 - ETA: 7s - loss: 8.0834 - acc: 0.4833 - ETA: 7s - loss: 8.8804 - acc: 0.4400 - ETA: 7s - loss: 8.5351 - acc: 0.4643 - ETA: 7s - loss: 8.4307 - acc: 0.4722 - ETA: 8s - loss: 8.5555 - acc: 0.4591 - ETA: 8s - loss: 8.9750 - acc: 0.4346 - ETA: 8s - loss: 8.8015 - acc: 0.4467 - ETA: 8s - loss: 9.0463 - acc: 0.4324 - ETA: 8s - loss: 9.1175 - acc: 0.4263 - ETA: 8s - loss: 9.1319 - acc: 0.4262 - ETA: 8s - loss: 9.2901 - acc: 0.4130 - ETA: 8s - loss: 9.2942 - acc: 0.4120 - ETA: 8s - loss: 9.3819 - acc: 0.4074 - ETA: 8s - loss: 9.4211 - acc: 0.4054 - ETA: 8s - loss: 9.3075 - acc: 0.4117 - ETA: 8s - loss: 9.2296 - acc: 0.4172 - ETA: 8s - loss: 9.2322 - acc: 0.4176 - ETA: 8s - loss: 9.1909 - acc: 0.4208 - ETA: 8s - loss: 9.0434 - acc: 0.4295 - ETA: 8s - loss: 8.9971 - acc: 0.4317 - ETA: 8s - loss: 8.8993 - acc: 0.4372 - ETA: 7s - loss: 8.8477 - acc: 0.4400 - ETA: 7s - loss: 8.9173 - acc: 0.4362 - ETA: 7s - loss: 8.9316 - acc: 0.4357 - ETA: 7s - loss: 8.9301 - acc: 0.4353 - ETA: 7s - loss: 8.9765 - acc: 0.4321 - ETA: 7s - loss: 8.9139 - acc: 0.4364 - ETA: 7s - loss: 8.9125 - acc: 0.4368 - ETA: 7s - loss: 8.7936 - acc: 0.4424 - ETA: 7s - loss: 8.7960 - acc: 0.4426 - ETA: 7s - loss: 8.8116 - acc: 0.4413 - ETA: 7s - loss: 8.7760 - acc: 0.4438 - ETA: 7s - loss: 8.8118 - acc: 0.4410 - ETA: 7s - loss: 8.8035 - acc: 0.4413 - ETA: 7s - loss: 8.7599 - acc: 0.4444 - ETA: 7s - loss: 8.6922 - acc: 0.4473 - ETA: 7s - loss: 8.7076 - acc: 0.4467 - ETA: 6s - loss: 8.7348 - acc: 0.4455 - ETA: 6s - loss: 8.7985 - acc: 0.4419 - ETA: 6s - loss: 8.8021 - acc: 0.4415 - ETA: 6s - loss: 8.8135 - acc: 0.4411 - ETA: 6s - loss: 8.7934 - acc: 0.4424 - ETA: 6s - loss: 8.7859 - acc: 0.4432 - ETA: 6s - loss: 8.8145 - acc: 0.4417 - ETA: 6s - loss: 8.8078 - acc: 0.4418 - ETA: 6s - loss: 8.8348 - acc: 0.4404 - ETA: 6s - loss: 8.8192 - acc: 0.4417 - ETA: 6s - loss: 8.8368 - acc: 0.4408 - ETA: 6s - loss: 8.8785 - acc: 0.4380 - ETA: 6s - loss: 8.8387 - acc: 0.4407 - ETA: 6s - loss: 8.8005 - acc: 0.4433 - ETA: 6s - loss: 8.8322 - acc: 0.4415 - ETA: 6s - loss: 8.8556 - acc: 0.4398 - ETA: 6s - loss: 8.8558 - acc: 0.4400 - ETA: 5s - loss: 8.8059 - acc: 0.4433 - ETA: 5s - loss: 8.8070 - acc: 0.4434 - ETA: 5s - loss: 8.7733 - acc: 0.4457 - ETA: 5s - loss: 8.7887 - acc: 0.4449 - ETA: 5s - loss: 8.8101 - acc: 0.4438 - ETA: 5s - loss: 8.8375 - acc: 0.4422 - ETA: 5s - loss: 8.8192 - acc: 0.4431 - ETA: 5s - loss: 8.8213 - acc: 0.4425 - ETA: 5s - loss: 8.8346 - acc: 0.4418 - ETA: 5s - loss: 8.8043 - acc: 0.4438 - ETA: 5s - loss: 8.8001 - acc: 0.4436 - ETA: 5s - loss: 8.8433 - acc: 0.4410 - ETA: 5s - loss: 8.8673 - acc: 0.4397 - ETA: 5s - loss: 8.8407 - acc: 0.4409 - ETA: 5s - loss: 8.8355 - acc: 0.4414 - ETA: 5s - loss: 8.8308 - acc: 0.4415 - ETA: 5s - loss: 8.8207 - acc: 0.4417 - ETA: 5s - loss: 8.8275 - acc: 0.4411 - ETA: 5s - loss: 8.8063 - acc: 0.4426 - ETA: 4s - loss: 8.7762 - acc: 0.4440 - ETA: 4s - loss: 8.7827 - acc: 0.4438 - ETA: 4s - loss: 8.7778 - acc: 0.4442 - ETA: 4s - loss: 8.7899 - acc: 0.4433 - ETA: 4s - loss: 8.7758 - acc: 0.4443 - ETA: 4s - loss: 8.7822 - acc: 0.4441 - ETA: 4s - loss: 8.7646 - acc: 0.4451 - ETA: 4s - loss: 8.7679 - acc: 0.4448 - ETA: 4s - loss: 8.7809 - acc: 0.4434 - ETA: 4s - loss: 8.8155 - acc: 0.4414 - ETA: 4s - loss: 8.7972 - acc: 0.4426 - ETA: 4s - loss: 8.7898 - acc: 0.4430 - ETA: 4s - loss: 8.7816 - acc: 0.4437 - ETA: 4s - loss: 8.7826 - acc: 0.4438 - ETA: 4s - loss: 8.8088 - acc: 0.4421 - ETA: 4s - loss: 8.7961 - acc: 0.4431 - ETA: 4s - loss: 8.8013 - acc: 0.4429 - ETA: 4s - loss: 8.7859 - acc: 0.4438 - ETA: 4s - loss: 8.7868 - acc: 0.4438 - ETA: 3s - loss: 8.8091 - acc: 0.4426 - ETA: 3s - loss: 8.8055 - acc: 0.4429 - ETA: 3s - loss: 8.7935 - acc: 0.4438 - ETA: 3s - loss: 8.7777 - acc: 0.4448 - ETA: 3s - loss: 8.7663 - acc: 0.4457 - ETA: 3s - loss: 8.7516 - acc: 0.4465 - ETA: 3s - loss: 8.7568 - acc: 0.4463 - ETA: 3s - loss: 8.7381 - acc: 0.4475 - ETA: 3s - loss: 8.7354 - acc: 0.4478 - ETA: 3s - loss: 8.7288 - acc: 0.4483 - ETA: 3s - loss: 8.7424 - acc: 0.4474 - ETA: 3s - loss: 8.7322 - acc: 0.4481 - ETA: 3s - loss: 8.7221 - acc: 0.4488 - ETA: 3s - loss: 8.7385 - acc: 0.4479 - ETA: 3s - loss: 8.7323 - acc: 0.4484 - ETA: 3s - loss: 8.7344 - acc: 0.4482 - ETA: 3s - loss: 8.7356 - acc: 0.4482 - ETA: 3s - loss: 8.7488 - acc: 0.4473 - ETA: 2s - loss: 8.7394 - acc: 0.4480 - ETA: 2s - loss: 8.7197 - acc: 0.4491 - ETA: 2s - loss: 8.7249 - acc: 0.4487 - ETA: 2s - loss: 8.7223 - acc: 0.4487 - ETA: 2s - loss: 8.7132 - acc: 0.4494 - ETA: 2s - loss: 8.7041 - acc: 0.4500 - ETA: 2s - loss: 8.6921 - acc: 0.4508 - ETA: 2s - loss: 8.6935 - acc: 0.4508 - ETA: 2s - loss: 8.6953 - acc: 0.4506 - ETA: 2s - loss: 8.7039 - acc: 0.4500 - ETA: 2s - loss: 8.6958 - acc: 0.4504 - ETA: 2s - loss: 8.7079 - acc: 0.4496 - ETA: 2s - loss: 8.6930 - acc: 0.4506 - ETA: 2s - loss: 8.6976 - acc: 0.4504 - ETA: 2s - loss: 8.7022 - acc: 0.4502 - ETA: 2s - loss: 8.7003 - acc: 0.4504 - ETA: 2s - loss: 8.7049 - acc: 0.4502 - ETA: 2s - loss: 8.7187 - acc: 0.4494 - ETA: 2s - loss: 8.7260 - acc: 0.4490 - ETA: 1s - loss: 8.7425 - acc: 0.4481 - ETA: 1s - loss: 8.7496 - acc: 0.4477 - ETA: 1s - loss: 8.7353 - acc: 0.4487 - ETA: 1s - loss: 8.7423 - acc: 0.4483 - ETA: 1s - loss: 8.7552 - acc: 0.4476 - ETA: 1s - loss: 8.7680 - acc: 0.4469 - ETA: 1s - loss: 8.7586 - acc: 0.4473 - ETA: 1s - loss: 8.7451 - acc: 0.4480 - ETA: 1s - loss: 8.7552 - acc: 0.4473 - ETA: 1s - loss: 8.7674 - acc: 0.4462 - ETA: 1s - loss: 8.7825 - acc: 0.4454 - ETA: 1s - loss: 8.7783 - acc: 0.4454 - ETA: 1s - loss: 8.7746 - acc: 0.4456 - ETA: 1s - loss: 8.7811 - acc: 0.4451 - ETA: 1s - loss: 8.7872 - acc: 0.4448 - ETA: 1s - loss: 8.7900 - acc: 0.4443 - ETA: 1s - loss: 8.7853 - acc: 0.4446 - ETA: 1s - loss: 8.7887 - acc: 0.4444 - ETA: 0s - loss: 8.7784 - acc: 0.4451 - ETA: 0s - loss: 8.7763 - acc: 0.4453 - ETA: 0s - loss: 8.7743 - acc: 0.4455 - ETA: 0s - loss: 8.7727 - acc: 0.4456 - ETA: 0s - loss: 8.7788 - acc: 0.4451 - ETA: 0s - loss: 8.7820 - acc: 0.4450 - ETA: 0s - loss: 8.7747 - acc: 0.4455 - ETA: 0s - loss: 8.7784 - acc: 0.4452 - ETA: 0s - loss: 8.7813 - acc: 0.4451 - ETA: 0s - loss: 8.7846 - acc: 0.4448 - ETA: 0s - loss: 8.7978 - acc: 0.4440 - ETA: 0s - loss: 8.8158 - acc: 0.4430 - ETA: 0s - loss: 8.8161 - acc: 0.4430 - ETA: 0s - loss: 8.8139 - acc: 0.4432 - ETA: 0s - loss: 8.8095 - acc: 0.4434 - ETA: 0s - loss: 8.7928 - acc: 0.4445 - ETA: 0s - loss: 8.8018 - acc: 0.4440 - ETA: 0s - loss: 8.7973 - acc: 0.4443Epoch 00009: val_loss did not improve
6680/6680 [==============================] - 9s - loss: 8.7883 - acc: 0.4448 - val_loss: 9.4871 - val_acc: 0.3557
Epoch 11/20
6640/6680 [============================>.] - ETA: 6s - loss: 9.6771 - acc: 0.4000 - ETA: 7s - loss: 8.6117 - acc: 0.4500 - ETA: 7s - loss: 8.0718 - acc: 0.4900 - ETA: 8s - loss: 8.6438 - acc: 0.4571 - ETA: 8s - loss: 8.4261 - acc: 0.4722 - ETA: 8s - loss: 8.4331 - acc: 0.4727 - ETA: 8s - loss: 8.2517 - acc: 0.4846 - ETA: 8s - loss: 8.3314 - acc: 0.4800 - ETA: 8s - loss: 8.2046 - acc: 0.4882 - ETA: 8s - loss: 8.2321 - acc: 0.4868 - ETA: 8s - loss: 8.2540 - acc: 0.4857 - ETA: 8s - loss: 8.3497 - acc: 0.4783 - ETA: 8s - loss: 8.2621 - acc: 0.4840 - ETA: 8s - loss: 8.3078 - acc: 0.4815 - ETA: 8s - loss: 8.3503 - acc: 0.4776 - ETA: 8s - loss: 8.5135 - acc: 0.4677 - ETA: 8s - loss: 8.5837 - acc: 0.4636 - ETA: 8s - loss: 8.5583 - acc: 0.4629 - ETA: 8s - loss: 8.4471 - acc: 0.4689 - ETA: 8s - loss: 8.4478 - acc: 0.4692 - ETA: 7s - loss: 8.4485 - acc: 0.4695 - ETA: 7s - loss: 8.4750 - acc: 0.4674 - ETA: 7s - loss: 8.5104 - acc: 0.4656 - ETA: 7s - loss: 8.5259 - acc: 0.4649 - ETA: 7s - loss: 8.5681 - acc: 0.4622 - ETA: 7s - loss: 8.6603 - acc: 0.4549 - ETA: 7s - loss: 8.7080 - acc: 0.4519 - ETA: 7s - loss: 8.6856 - acc: 0.4527 - ETA: 7s - loss: 8.6638 - acc: 0.4544 - ETA: 7s - loss: 8.6296 - acc: 0.4568 - ETA: 7s - loss: 8.5938 - acc: 0.4589 - ETA: 7s - loss: 8.6150 - acc: 0.4578 - ETA: 7s - loss: 8.6005 - acc: 0.4583 - ETA: 7s - loss: 8.6202 - acc: 0.4574 - ETA: 7s - loss: 8.6621 - acc: 0.4550 - ETA: 7s - loss: 8.6868 - acc: 0.4528 - ETA: 7s - loss: 8.7243 - acc: 0.4507 - ETA: 6s - loss: 8.7387 - acc: 0.4500 - ETA: 6s - loss: 8.7939 - acc: 0.4468 - ETA: 6s - loss: 8.7967 - acc: 0.4463 - ETA: 6s - loss: 8.7985 - acc: 0.4463 - ETA: 6s - loss: 8.8098 - acc: 0.4458 - ETA: 6s - loss: 8.8019 - acc: 0.4465 - ETA: 6s - loss: 8.7667 - acc: 0.4489 - ETA: 6s - loss: 8.7355 - acc: 0.4505 - ETA: 6s - loss: 8.7096 - acc: 0.4522 - ETA: 6s - loss: 8.6781 - acc: 0.4537 - ETA: 6s - loss: 8.6593 - acc: 0.4541 - ETA: 6s - loss: 8.6309 - acc: 0.4561 - ETA: 6s - loss: 8.6441 - acc: 0.4550 - ETA: 6s - loss: 8.6202 - acc: 0.4563 - ETA: 6s - loss: 8.6327 - acc: 0.4557 - ETA: 6s - loss: 8.6238 - acc: 0.4561 - ETA: 5s - loss: 8.6726 - acc: 0.4532 - ETA: 5s - loss: 8.6833 - acc: 0.4527 - ETA: 5s - loss: 8.6643 - acc: 0.4540 - ETA: 5s - loss: 8.6601 - acc: 0.4539 - ETA: 5s - loss: 8.6712 - acc: 0.4526 - ETA: 5s - loss: 8.6945 - acc: 0.4508 - ETA: 5s - loss: 8.7037 - acc: 0.4500 - ETA: 5s - loss: 8.6871 - acc: 0.4508 - ETA: 5s - loss: 8.6843 - acc: 0.4508 - ETA: 5s - loss: 8.7311 - acc: 0.4480 - ETA: 5s - loss: 8.7270 - acc: 0.4484 - ETA: 5s - loss: 8.7424 - acc: 0.4473 - ETA: 5s - loss: 8.7688 - acc: 0.4455 - ETA: 5s - loss: 8.8014 - acc: 0.4430 - ETA: 5s - loss: 8.7788 - acc: 0.4445 - ETA: 5s - loss: 8.7916 - acc: 0.4439 - ETA: 5s - loss: 8.7870 - acc: 0.4443 - ETA: 5s - loss: 8.7790 - acc: 0.4441 - ETA: 5s - loss: 8.7802 - acc: 0.4441 - ETA: 4s - loss: 8.8041 - acc: 0.4422 - ETA: 4s - loss: 8.8112 - acc: 0.4416 - ETA: 4s - loss: 8.8120 - acc: 0.4417 - ETA: 4s - loss: 8.8346 - acc: 0.4402 - ETA: 4s - loss: 8.8350 - acc: 0.4403 - ETA: 4s - loss: 8.8355 - acc: 0.4404 - ETA: 4s - loss: 8.8164 - acc: 0.4415 - ETA: 4s - loss: 8.8306 - acc: 0.4401 - ETA: 4s - loss: 8.8014 - acc: 0.4420 - ETA: 4s - loss: 8.7901 - acc: 0.4421 - ETA: 4s - loss: 8.7913 - acc: 0.4422 - ETA: 4s - loss: 8.8063 - acc: 0.4414 - ETA: 4s - loss: 8.7986 - acc: 0.4418 - ETA: 4s - loss: 8.8038 - acc: 0.4413 - ETA: 4s - loss: 8.7998 - acc: 0.4414 - ETA: 4s - loss: 8.8011 - acc: 0.4412 - ETA: 4s - loss: 8.7915 - acc: 0.4419 - ETA: 4s - loss: 8.7850 - acc: 0.4423 - ETA: 4s - loss: 8.7949 - acc: 0.4415 - ETA: 3s - loss: 8.7700 - acc: 0.4430 - ETA: 3s - loss: 8.7765 - acc: 0.4425 - ETA: 3s - loss: 8.7860 - acc: 0.4421 - ETA: 3s - loss: 8.7869 - acc: 0.4421 - ETA: 3s - loss: 8.8019 - acc: 0.4412 - ETA: 3s - loss: 8.7944 - acc: 0.4418 - ETA: 3s - loss: 8.7829 - acc: 0.4426 - ETA: 3s - loss: 8.7756 - acc: 0.4432 - ETA: 3s - loss: 8.7534 - acc: 0.4443 - ETA: 3s - loss: 8.7427 - acc: 0.4451 - ETA: 3s - loss: 8.7400 - acc: 0.4454 - ETA: 3s - loss: 8.7418 - acc: 0.4449 - ETA: 3s - loss: 8.7330 - acc: 0.4455 - ETA: 3s - loss: 8.7345 - acc: 0.4453 - ETA: 3s - loss: 8.7433 - acc: 0.4448 - ETA: 3s - loss: 8.7288 - acc: 0.4458 - ETA: 3s - loss: 8.7301 - acc: 0.4459 - ETA: 3s - loss: 8.7330 - acc: 0.4457 - ETA: 3s - loss: 8.7308 - acc: 0.4457 - ETA: 2s - loss: 8.7249 - acc: 0.4462 - ETA: 2s - loss: 8.7180 - acc: 0.4462 - ETA: 2s - loss: 8.7164 - acc: 0.4463 - ETA: 2s - loss: 8.7354 - acc: 0.4452 - ETA: 2s - loss: 8.7222 - acc: 0.4457 - ETA: 2s - loss: 8.7234 - acc: 0.4457 - ETA: 2s - loss: 8.7076 - acc: 0.4468 - ETA: 2s - loss: 8.7127 - acc: 0.4464 - ETA: 2s - loss: 8.7038 - acc: 0.4471 - ETA: 2s - loss: 8.7219 - acc: 0.4461 - ETA: 2s - loss: 8.7299 - acc: 0.4457 - ETA: 2s - loss: 8.7146 - acc: 0.4467 - ETA: 2s - loss: 8.7082 - acc: 0.4470 - ETA: 2s - loss: 8.7063 - acc: 0.4472 - ETA: 2s - loss: 8.7057 - acc: 0.4470 - ETA: 2s - loss: 8.7070 - acc: 0.4468 - ETA: 2s - loss: 8.6960 - acc: 0.4475 - ETA: 2s - loss: 8.7038 - acc: 0.4471 - ETA: 2s - loss: 8.7051 - acc: 0.4471 - ETA: 1s - loss: 8.7050 - acc: 0.4469 - ETA: 1s - loss: 8.7079 - acc: 0.4466 - ETA: 1s - loss: 8.7122 - acc: 0.4464 - ETA: 1s - loss: 8.7177 - acc: 0.4459 - ETA: 1s - loss: 8.7302 - acc: 0.4450 - ETA: 1s - loss: 8.7460 - acc: 0.4441 - ETA: 1s - loss: 8.7392 - acc: 0.4445 - ETA: 1s - loss: 8.7347 - acc: 0.4447 - ETA: 1s - loss: 8.7354 - acc: 0.4446 - ETA: 1s - loss: 8.7308 - acc: 0.4448 - ETA: 1s - loss: 8.7289 - acc: 0.4450 - ETA: 1s - loss: 8.7223 - acc: 0.4452 - ETA: 1s - loss: 8.7290 - acc: 0.4449 - ETA: 1s - loss: 8.7183 - acc: 0.4455 - ETA: 1s - loss: 8.7089 - acc: 0.4460 - ETA: 1s - loss: 8.7047 - acc: 0.4462 - ETA: 1s - loss: 8.6977 - acc: 0.4466 - ETA: 1s - loss: 8.7046 - acc: 0.4461 - ETA: 0s - loss: 8.7025 - acc: 0.4463 - ETA: 0s - loss: 8.7143 - acc: 0.4457 - ETA: 0s - loss: 8.7208 - acc: 0.4453 - ETA: 0s - loss: 8.7145 - acc: 0.4455 - ETA: 0s - loss: 8.7229 - acc: 0.4451 - ETA: 0s - loss: 8.7265 - acc: 0.4449 - ETA: 0s - loss: 8.7204 - acc: 0.4453 - ETA: 0s - loss: 8.7276 - acc: 0.4448 - ETA: 0s - loss: 8.7267 - acc: 0.4449 - ETA: 0s - loss: 8.7353 - acc: 0.4444 - ETA: 0s - loss: 8.7458 - acc: 0.4437 - ETA: 0s - loss: 8.7516 - acc: 0.4434 - ETA: 0s - loss: 8.7498 - acc: 0.4436 - ETA: 0s - loss: 8.7385 - acc: 0.4443 - ETA: 0s - loss: 8.7393 - acc: 0.4443 - ETA: 0s - loss: 8.7545 - acc: 0.4433 - ETA: 0s - loss: 8.7458 - acc: 0.4436 - ETA: 0s - loss: 8.7466 - acc: 0.4436 - ETA: 0s - loss: 8.7376 - acc: 0.4443Epoch 00010: val_loss improved from 9.46046 to 9.32618, saving model to saved_models/weights.best.VGG16.hdf5
6680/6680 [==============================] - 9s - loss: 8.7432 - acc: 0.4440 - val_loss: 9.3262 - val_acc: 0.3545
Epoch 12/20
6660/6680 [============================>.] - ETA: 6s - loss: 6.4503 - acc: 0.6000 - ETA: 7s - loss: 8.3314 - acc: 0.4833 - ETA: 8s - loss: 8.5450 - acc: 0.4700 - ETA: 8s - loss: 8.5213 - acc: 0.4714 - ETA: 9s - loss: 8.8664 - acc: 0.4500 - ETA: 8s - loss: 9.4228 - acc: 0.4045 - ETA: 8s - loss: 9.2751 - acc: 0.4154 - ETA: 8s - loss: 9.0593 - acc: 0.4300 - ETA: 8s - loss: 9.0840 - acc: 0.4294 - ETA: 8s - loss: 9.0189 - acc: 0.4342 - ETA: 8s - loss: 8.9537 - acc: 0.4381 - ETA: 8s - loss: 8.9460 - acc: 0.4391 - ETA: 8s - loss: 8.9075 - acc: 0.4420 - ETA: 8s - loss: 8.9082 - acc: 0.4407 - ETA: 8s - loss: 8.8497 - acc: 0.4448 - ETA: 8s - loss: 8.9286 - acc: 0.4403 - ETA: 8s - loss: 8.8762 - acc: 0.4439 - ETA: 8s - loss: 8.8522 - acc: 0.4456 - ETA: 8s - loss: 8.7858 - acc: 0.4500 - ETA: 8s - loss: 8.7665 - acc: 0.4514 - ETA: 8s - loss: 8.7587 - acc: 0.4513 - ETA: 8s - loss: 8.7074 - acc: 0.4537 - ETA: 8s - loss: 8.7343 - acc: 0.4523 - ETA: 8s - loss: 8.7099 - acc: 0.4533 - ETA: 8s - loss: 8.6254 - acc: 0.4574 - ETA: 8s - loss: 8.6024 - acc: 0.4592 - ETA: 7s - loss: 8.6446 - acc: 0.4569 - ETA: 7s - loss: 8.6225 - acc: 0.4585 - ETA: 7s - loss: 8.6329 - acc: 0.4573 - ETA: 7s - loss: 8.5989 - acc: 0.4596 - ETA: 7s - loss: 8.5806 - acc: 0.4610 - ETA: 7s - loss: 8.6066 - acc: 0.4590 - ETA: 7s - loss: 8.5893 - acc: 0.4603 - ETA: 7s - loss: 8.5854 - acc: 0.4608 - ETA: 7s - loss: 8.5698 - acc: 0.4619 - ETA: 7s - loss: 8.5550 - acc: 0.4630 - ETA: 7s - loss: 8.5751 - acc: 0.4620 - ETA: 7s - loss: 8.5802 - acc: 0.4596 - ETA: 7s - loss: 8.6094 - acc: 0.4580 - ETA: 7s - loss: 8.6475 - acc: 0.4558 - ETA: 7s - loss: 8.6734 - acc: 0.4544 - ETA: 7s - loss: 8.6584 - acc: 0.4556 - ETA: 7s - loss: 8.6348 - acc: 0.4566 - ETA: 6s - loss: 8.6497 - acc: 0.4559 - ETA: 6s - loss: 8.6641 - acc: 0.4552 - ETA: 6s - loss: 8.6430 - acc: 0.4562 - ETA: 6s - loss: 8.6487 - acc: 0.4555 - ETA: 6s - loss: 8.6448 - acc: 0.4559 - ETA: 6s - loss: 8.6437 - acc: 0.4558 - ETA: 6s - loss: 8.6567 - acc: 0.4552 - ETA: 6s - loss: 8.6868 - acc: 0.4530 - ETA: 6s - loss: 8.6616 - acc: 0.4540 - ETA: 6s - loss: 8.6432 - acc: 0.4548 - ETA: 6s - loss: 8.6327 - acc: 0.4557 - ETA: 6s - loss: 8.6189 - acc: 0.4560 - ETA: 6s - loss: 8.6015 - acc: 0.4573 - ETA: 6s - loss: 8.5558 - acc: 0.4603 - ETA: 6s - loss: 8.5260 - acc: 0.4623 - ETA: 6s - loss: 8.4972 - acc: 0.4642 - ETA: 5s - loss: 8.5050 - acc: 0.4636 - ETA: 5s - loss: 8.5513 - acc: 0.4608 - ETA: 5s - loss: 8.5606 - acc: 0.4603 - ETA: 5s - loss: 8.5624 - acc: 0.4605 - ETA: 5s - loss: 8.5608 - acc: 0.4607 - ETA: 5s - loss: 8.5922 - acc: 0.4586 - ETA: 5s - loss: 8.5840 - acc: 0.4592 - ETA: 5s - loss: 8.5579 - acc: 0.4610 - ETA: 5s - loss: 8.5846 - acc: 0.4590 - ETA: 5s - loss: 8.5748 - acc: 0.4596 - ETA: 5s - loss: 8.5555 - acc: 0.4609 - ETA: 5s - loss: 8.5462 - acc: 0.4608 - ETA: 5s - loss: 8.5450 - acc: 0.4610 - ETA: 5s - loss: 8.5460 - acc: 0.4608 - ETA: 5s - loss: 8.5671 - acc: 0.4597 - ETA: 5s - loss: 8.5821 - acc: 0.4588 - ETA: 5s - loss: 8.5949 - acc: 0.4581 - ETA: 5s - loss: 8.6362 - acc: 0.4557 - ETA: 5s - loss: 8.6312 - acc: 0.4553 - ETA: 5s - loss: 8.6239 - acc: 0.4558 - ETA: 4s - loss: 8.6227 - acc: 0.4558 - ETA: 4s - loss: 8.6090 - acc: 0.4563 - ETA: 4s - loss: 8.6177 - acc: 0.4556 - ETA: 4s - loss: 8.6158 - acc: 0.4558 - ETA: 4s - loss: 8.5853 - acc: 0.4576 - ETA: 4s - loss: 8.6031 - acc: 0.4566 - ETA: 4s - loss: 8.6042 - acc: 0.4565 - ETA: 4s - loss: 8.6167 - acc: 0.4558 - ETA: 4s - loss: 8.6262 - acc: 0.4549 - ETA: 4s - loss: 8.6245 - acc: 0.4551 - ETA: 4s - loss: 8.5908 - acc: 0.4573 - ETA: 4s - loss: 8.5898 - acc: 0.4573 - ETA: 4s - loss: 8.6329 - acc: 0.4547 - ETA: 4s - loss: 8.6266 - acc: 0.4552 - ETA: 4s - loss: 8.6121 - acc: 0.4559 - ETA: 4s - loss: 8.6149 - acc: 0.4559 - ETA: 4s - loss: 8.6090 - acc: 0.4563 - ETA: 3s - loss: 8.6034 - acc: 0.4568 - ETA: 3s - loss: 8.5911 - acc: 0.4575 - ETA: 3s - loss: 8.5785 - acc: 0.4579 - ETA: 3s - loss: 8.5528 - acc: 0.4596 - ETA: 3s - loss: 8.5612 - acc: 0.4588 - ETA: 3s - loss: 8.5643 - acc: 0.4587 - ETA: 3s - loss: 8.5722 - acc: 0.4576 - ETA: 3s - loss: 8.5635 - acc: 0.4583 - ETA: 3s - loss: 8.5898 - acc: 0.4568 - ETA: 3s - loss: 8.5855 - acc: 0.4569 - ETA: 3s - loss: 8.5806 - acc: 0.4573 - ETA: 3s - loss: 8.5795 - acc: 0.4575 - ETA: 3s - loss: 8.5896 - acc: 0.4570 - ETA: 3s - loss: 8.5997 - acc: 0.4565 - ETA: 3s - loss: 8.6060 - acc: 0.4559 - ETA: 3s - loss: 8.6158 - acc: 0.4554 - ETA: 3s - loss: 8.6108 - acc: 0.4558 - ETA: 3s - loss: 8.6148 - acc: 0.4556 - ETA: 2s - loss: 8.6210 - acc: 0.4551 - ETA: 2s - loss: 8.6208 - acc: 0.4548 - ETA: 2s - loss: 8.6304 - acc: 0.4541 - ETA: 2s - loss: 8.6462 - acc: 0.4532 - ETA: 2s - loss: 8.6448 - acc: 0.4534 - ETA: 2s - loss: 8.6524 - acc: 0.4530 - ETA: 2s - loss: 8.6550 - acc: 0.4525 - ETA: 2s - loss: 8.6457 - acc: 0.4529 - ETA: 2s - loss: 8.6607 - acc: 0.4521 - ETA: 2s - loss: 8.6560 - acc: 0.4522 - ETA: 2s - loss: 8.6746 - acc: 0.4510 - ETA: 2s - loss: 8.6706 - acc: 0.4512 - ETA: 2s - loss: 8.6885 - acc: 0.4500 - ETA: 2s - loss: 8.6881 - acc: 0.4500 - ETA: 2s - loss: 8.6990 - acc: 0.4494 - ETA: 2s - loss: 8.6978 - acc: 0.4494 - ETA: 2s - loss: 8.6898 - acc: 0.4500 - ETA: 2s - loss: 8.6727 - acc: 0.4511 - ETA: 1s - loss: 8.6597 - acc: 0.4519 - ETA: 1s - loss: 8.6543 - acc: 0.4523 - ETA: 1s - loss: 8.6559 - acc: 0.4523 - ETA: 1s - loss: 8.6455 - acc: 0.4530 - ETA: 1s - loss: 8.6323 - acc: 0.4539 - ETA: 1s - loss: 8.6195 - acc: 0.4546 - ETA: 1s - loss: 8.5990 - acc: 0.4558 - ETA: 1s - loss: 8.6008 - acc: 0.4558 - ETA: 1s - loss: 8.6101 - acc: 0.4552 - ETA: 1s - loss: 8.6135 - acc: 0.4550 - ETA: 1s - loss: 8.6067 - acc: 0.4555 - ETA: 1s - loss: 8.6001 - acc: 0.4560 - ETA: 1s - loss: 8.5991 - acc: 0.4561 - ETA: 1s - loss: 8.6044 - acc: 0.4557 - ETA: 1s - loss: 8.6111 - acc: 0.4553 - ETA: 1s - loss: 8.6101 - acc: 0.4555 - ETA: 1s - loss: 8.6119 - acc: 0.4554 - ETA: 1s - loss: 8.6163 - acc: 0.4552 - ETA: 0s - loss: 8.6180 - acc: 0.4552 - ETA: 0s - loss: 8.6330 - acc: 0.4543 - ETA: 0s - loss: 8.6429 - acc: 0.4536 - ETA: 0s - loss: 8.6443 - acc: 0.4536 - ETA: 0s - loss: 8.6484 - acc: 0.4534 - ETA: 0s - loss: 8.6604 - acc: 0.4526 - ETA: 0s - loss: 8.6569 - acc: 0.4527 - ETA: 0s - loss: 8.6506 - acc: 0.4532 - ETA: 0s - loss: 8.6366 - acc: 0.4541 - ETA: 0s - loss: 8.6355 - acc: 0.4543 - ETA: 0s - loss: 8.6328 - acc: 0.4544 - ETA: 0s - loss: 8.6318 - acc: 0.4545 - ETA: 0s - loss: 8.6307 - acc: 0.4546 - ETA: 0s - loss: 8.6272 - acc: 0.4549 - ETA: 0s - loss: 8.6416 - acc: 0.4540 - ETA: 0s - loss: 8.6337 - acc: 0.4543 - ETA: 0s - loss: 8.6381 - acc: 0.4538 - ETA: 0s - loss: 8.6348 - acc: 0.4539Epoch 00011: val_loss improved from 9.32618 to 9.29131, saving model to saved_models/weights.best.VGG16.hdf5
6680/6680 [==============================] - 9s - loss: 8.6409 - acc: 0.4534 - val_loss: 9.2913 - val_acc: 0.3533
Epoch 13/20
6640/6680 [============================>.] - ETA: 9s - loss: 8.8676 - acc: 0.4500 - ETA: 8s - loss: 9.2064 - acc: 0.4000 - ETA: 9s - loss: 10.0371 - acc: 0.3600 - ETA: 9s - loss: 9.6473 - acc: 0.3857  - ETA: 9s - loss: 9.5791 - acc: 0.3889 - ETA: 8s - loss: 9.0107 - acc: 0.4273 - ETA: 8s - loss: 8.9892 - acc: 0.4308 - ETA: 8s - loss: 8.9209 - acc: 0.4367 - ETA: 8s - loss: 8.9143 - acc: 0.4382 - ETA: 8s - loss: 9.1327 - acc: 0.4237 - ETA: 8s - loss: 8.7236 - acc: 0.4500 - ETA: 8s - loss: 8.6658 - acc: 0.4543 - ETA: 8s - loss: 8.7688 - acc: 0.4480 - ETA: 8s - loss: 8.6566 - acc: 0.4556 - ETA: 8s - loss: 8.7267 - acc: 0.4517 - ETA: 8s - loss: 8.7097 - acc: 0.4532 - ETA: 8s - loss: 8.7437 - acc: 0.4515 - ETA: 8s - loss: 8.6586 - acc: 0.4571 - ETA: 8s - loss: 8.6046 - acc: 0.4608 - ETA: 8s - loss: 8.5149 - acc: 0.4667 - ETA: 8s - loss: 8.4733 - acc: 0.4695 - ETA: 8s - loss: 8.5853 - acc: 0.4628 - ETA: 7s - loss: 8.4909 - acc: 0.4689 - ETA: 7s - loss: 8.3526 - acc: 0.4777 - ETA: 7s - loss: 8.4397 - acc: 0.4724 - ETA: 7s - loss: 8.4321 - acc: 0.4725 - ETA: 7s - loss: 8.3885 - acc: 0.4745 - ETA: 7s - loss: 8.3052 - acc: 0.4791 - ETA: 7s - loss: 8.3390 - acc: 0.4772 - ETA: 7s - loss: 8.3569 - acc: 0.4763 - ETA: 7s - loss: 8.4003 - acc: 0.4738 - ETA: 7s - loss: 8.4535 - acc: 0.4706 - ETA: 7s - loss: 8.5211 - acc: 0.4662 - ETA: 7s - loss: 8.5360 - acc: 0.4649 - ETA: 7s - loss: 8.5107 - acc: 0.4667 - ETA: 7s - loss: 8.4416 - acc: 0.4711 - ETA: 7s - loss: 8.4533 - acc: 0.4705 - ETA: 7s - loss: 8.4324 - acc: 0.4720 - ETA: 6s - loss: 8.4547 - acc: 0.4701 - ETA: 6s - loss: 8.4634 - acc: 0.4688 - ETA: 6s - loss: 8.4869 - acc: 0.4671 - ETA: 6s - loss: 8.5189 - acc: 0.4649 - ETA: 6s - loss: 8.5645 - acc: 0.4622 - ETA: 6s - loss: 8.6263 - acc: 0.4585 - ETA: 6s - loss: 8.6674 - acc: 0.4561 - ETA: 6s - loss: 8.6717 - acc: 0.4560 - ETA: 6s - loss: 8.6834 - acc: 0.4547 - ETA: 6s - loss: 8.7038 - acc: 0.4536 - ETA: 6s - loss: 8.6675 - acc: 0.4556 - ETA: 6s - loss: 8.6557 - acc: 0.4564 - ETA: 6s - loss: 8.6465 - acc: 0.4563 - ETA: 6s - loss: 8.6508 - acc: 0.4562 - ETA: 6s - loss: 8.6333 - acc: 0.4565 - ETA: 6s - loss: 8.6471 - acc: 0.4550 - ETA: 6s - loss: 8.6523 - acc: 0.4541 - ETA: 5s - loss: 8.5850 - acc: 0.4579 - ETA: 5s - loss: 8.5417 - acc: 0.4603 - ETA: 5s - loss: 8.5608 - acc: 0.4593 - ETA: 5s - loss: 8.5592 - acc: 0.4596 - ETA: 5s - loss: 8.5536 - acc: 0.4594 - ETA: 5s - loss: 8.5654 - acc: 0.4589 - ETA: 5s - loss: 8.5575 - acc: 0.4595 - ETA: 5s - loss: 8.5316 - acc: 0.4609 - ETA: 5s - loss: 8.5113 - acc: 0.4619 - ETA: 5s - loss: 8.5192 - acc: 0.4614 - ETA: 5s - loss: 8.5140 - acc: 0.4612 - ETA: 5s - loss: 8.5373 - acc: 0.4596 - ETA: 5s - loss: 8.5000 - acc: 0.4616 - ETA: 5s - loss: 8.4841 - acc: 0.4621 - ETA: 5s - loss: 8.4842 - acc: 0.4623 - ETA: 5s - loss: 8.5063 - acc: 0.4611 - ETA: 5s - loss: 8.5118 - acc: 0.4606 - ETA: 4s - loss: 8.5220 - acc: 0.4601 - ETA: 4s - loss: 8.5373 - acc: 0.4590 - ETA: 4s - loss: 8.5580 - acc: 0.4576 - ETA: 4s - loss: 8.5509 - acc: 0.4578 - ETA: 4s - loss: 8.5294 - acc: 0.4593 - ETA: 4s - loss: 8.5493 - acc: 0.4579 - ETA: 4s - loss: 8.5789 - acc: 0.4559 - ETA: 4s - loss: 8.5728 - acc: 0.4562 - ETA: 4s - loss: 8.5667 - acc: 0.4567 - ETA: 4s - loss: 8.6042 - acc: 0.4545 - ETA: 4s - loss: 8.5981 - acc: 0.4551 - ETA: 4s - loss: 8.6204 - acc: 0.4538 - ETA: 4s - loss: 8.6349 - acc: 0.4529 - ETA: 4s - loss: 8.6207 - acc: 0.4534 - ETA: 4s - loss: 8.6372 - acc: 0.4526 - ETA: 4s - loss: 8.6367 - acc: 0.4522 - ETA: 4s - loss: 8.6482 - acc: 0.4517 - ETA: 4s - loss: 8.6507 - acc: 0.4516 - ETA: 4s - loss: 8.6318 - acc: 0.4524 - ETA: 3s - loss: 8.6098 - acc: 0.4538 - ETA: 3s - loss: 8.6168 - acc: 0.4535 - ETA: 3s - loss: 8.6084 - acc: 0.4537 - ETA: 3s - loss: 8.6069 - acc: 0.4539 - ETA: 3s - loss: 8.6057 - acc: 0.4539 - ETA: 3s - loss: 8.5919 - acc: 0.4548 - ETA: 3s - loss: 8.5874 - acc: 0.4551 - ETA: 3s - loss: 8.5863 - acc: 0.4553 - ETA: 3s - loss: 8.5904 - acc: 0.4550 - ETA: 3s - loss: 8.5812 - acc: 0.4556 - ETA: 3s - loss: 8.5802 - acc: 0.4558 - ETA: 3s - loss: 8.6023 - acc: 0.4546 - ETA: 3s - loss: 8.5935 - acc: 0.4552 - ETA: 3s - loss: 8.5885 - acc: 0.4557 - ETA: 3s - loss: 8.5798 - acc: 0.4563 - ETA: 3s - loss: 8.5787 - acc: 0.4565 - ETA: 3s - loss: 8.6006 - acc: 0.4550 - ETA: 3s - loss: 8.5922 - acc: 0.4555 - ETA: 3s - loss: 8.5903 - acc: 0.4554 - ETA: 2s - loss: 8.5727 - acc: 0.4560 - ETA: 2s - loss: 8.5753 - acc: 0.4560 - ETA: 2s - loss: 8.5670 - acc: 0.4566 - ETA: 2s - loss: 8.5836 - acc: 0.4557 - ETA: 2s - loss: 8.5934 - acc: 0.4550 - ETA: 2s - loss: 8.5855 - acc: 0.4556 - ETA: 2s - loss: 8.5985 - acc: 0.4544 - ETA: 2s - loss: 8.5810 - acc: 0.4555 - ETA: 2s - loss: 8.5834 - acc: 0.4554 - ETA: 2s - loss: 8.5791 - acc: 0.4558 - ETA: 2s - loss: 8.5749 - acc: 0.4561 - ETA: 2s - loss: 8.5872 - acc: 0.4555 - ETA: 2s - loss: 8.5802 - acc: 0.4558 - ETA: 2s - loss: 8.5826 - acc: 0.4558 - ETA: 2s - loss: 8.5625 - acc: 0.4571 - ETA: 2s - loss: 8.5406 - acc: 0.4585 - ETA: 2s - loss: 8.5306 - acc: 0.4592 - ETA: 2s - loss: 8.5458 - acc: 0.4583 - ETA: 1s - loss: 8.5467 - acc: 0.4583 - ETA: 1s - loss: 8.5500 - acc: 0.4580 - ETA: 1s - loss: 8.5524 - acc: 0.4580 - ETA: 1s - loss: 8.5430 - acc: 0.4585 - ETA: 1s - loss: 8.5494 - acc: 0.4580 - ETA: 1s - loss: 8.5467 - acc: 0.4581 - ETA: 1s - loss: 8.5342 - acc: 0.4590 - ETA: 1s - loss: 8.5193 - acc: 0.4599 - ETA: 1s - loss: 8.5247 - acc: 0.4596 - ETA: 1s - loss: 8.5169 - acc: 0.4601 - ETA: 1s - loss: 8.5010 - acc: 0.4609 - ETA: 1s - loss: 8.4896 - acc: 0.4615 - ETA: 1s - loss: 8.4901 - acc: 0.4614 - ETA: 1s - loss: 8.4836 - acc: 0.4619 - ETA: 1s - loss: 8.4668 - acc: 0.4630 - ETA: 1s - loss: 8.4724 - acc: 0.4628 - ETA: 1s - loss: 8.4806 - acc: 0.4623 - ETA: 1s - loss: 8.4836 - acc: 0.4621 - ETA: 1s - loss: 8.4891 - acc: 0.4618 - ETA: 0s - loss: 8.4566 - acc: 0.4639 - ETA: 0s - loss: 8.4594 - acc: 0.4638 - ETA: 0s - loss: 8.4631 - acc: 0.4636 - ETA: 0s - loss: 8.4502 - acc: 0.4641 - ETA: 0s - loss: 8.4507 - acc: 0.4639 - ETA: 0s - loss: 8.4511 - acc: 0.4638 - ETA: 0s - loss: 8.4513 - acc: 0.4637 - ETA: 0s - loss: 8.4488 - acc: 0.4639 - ETA: 0s - loss: 8.4485 - acc: 0.4639 - ETA: 0s - loss: 8.4522 - acc: 0.4634 - ETA: 0s - loss: 8.4471 - acc: 0.4638 - ETA: 0s - loss: 8.4473 - acc: 0.4639 - ETA: 0s - loss: 8.4460 - acc: 0.4638 - ETA: 0s - loss: 8.4473 - acc: 0.4634 - ETA: 0s - loss: 8.4449 - acc: 0.4637 - ETA: 0s - loss: 8.4524 - acc: 0.4633 - ETA: 0s - loss: 8.4525 - acc: 0.4633 - ETA: 0s - loss: 8.4605 - acc: 0.4628Epoch 00012: val_loss improved from 9.29131 to 9.10444, saving model to saved_models/weights.best.VGG16.hdf5
6680/6680 [==============================] - 9s - loss: 8.4725 - acc: 0.4621 - val_loss: 9.1044 - val_acc: 0.3701
Epoch 14/20
6660/6680 [============================>.] - ETA: 6s - loss: 8.8651 - acc: 0.4500 - ETA: 8s - loss: 8.0610 - acc: 0.5000 - ETA: 8s - loss: 7.7972 - acc: 0.5100 - ETA: 8s - loss: 8.1025 - acc: 0.4929 - ETA: 8s - loss: 8.6309 - acc: 0.4611 - ETA: 8s - loss: 8.8210 - acc: 0.4500 - ETA: 9s - loss: 8.7575 - acc: 0.4542 - ETA: 8s - loss: 8.8304 - acc: 0.4500 - ETA: 8s - loss: 9.0362 - acc: 0.4375 - ETA: 8s - loss: 9.1515 - acc: 0.4306 - ETA: 8s - loss: 9.0423 - acc: 0.4375 - ETA: 8s - loss: 8.9530 - acc: 0.4432 - ETA: 9s - loss: 8.9456 - acc: 0.4438 - ETA: 9s - loss: 8.8472 - acc: 0.4500 - ETA: 8s - loss: 8.9061 - acc: 0.4464 - ETA: 8s - loss: 9.0117 - acc: 0.4400 - ETA: 8s - loss: 9.0029 - acc: 0.4406 - ETA: 8s - loss: 8.9951 - acc: 0.4412 - ETA: 8s - loss: 8.8763 - acc: 0.4486 - ETA: 8s - loss: 8.7909 - acc: 0.4539 - ETA: 8s - loss: 8.8349 - acc: 0.4513 - ETA: 8s - loss: 8.8172 - acc: 0.4524 - ETA: 8s - loss: 8.7462 - acc: 0.4568 - ETA: 8s - loss: 8.7339 - acc: 0.4576 - ETA: 8s - loss: 8.6556 - acc: 0.4625 - ETA: 8s - loss: 8.6864 - acc: 0.4590 - ETA: 8s - loss: 8.6623 - acc: 0.4606 - ETA: 8s - loss: 8.6427 - acc: 0.4611 - ETA: 7s - loss: 8.6105 - acc: 0.4625 - ETA: 7s - loss: 8.6059 - acc: 0.4629 - ETA: 7s - loss: 8.5438 - acc: 0.4667 - ETA: 7s - loss: 8.5288 - acc: 0.4677 - ETA: 7s - loss: 8.4889 - acc: 0.4703 - ETA: 7s - loss: 8.5616 - acc: 0.4659 - ETA: 7s - loss: 8.5350 - acc: 0.4676 - ETA: 7s - loss: 8.5904 - acc: 0.4643 - ETA: 7s - loss: 8.5085 - acc: 0.4694 - ETA: 7s - loss: 8.4567 - acc: 0.4716 - ETA: 7s - loss: 8.4678 - acc: 0.4697 - ETA: 7s - loss: 8.4324 - acc: 0.4714 - ETA: 7s - loss: 8.4842 - acc: 0.4684 - ETA: 7s - loss: 8.5037 - acc: 0.4673 - ETA: 7s - loss: 8.4931 - acc: 0.4681 - ETA: 7s - loss: 8.5398 - acc: 0.4653 - ETA: 7s - loss: 8.5868 - acc: 0.4621 - ETA: 6s - loss: 8.6087 - acc: 0.4607 - ETA: 6s - loss: 8.6233 - acc: 0.4599 - ETA: 6s - loss: 8.6631 - acc: 0.4575 - ETA: 6s - loss: 8.6250 - acc: 0.4600 - ETA: 6s - loss: 8.5968 - acc: 0.4619 - ETA: 6s - loss: 8.6401 - acc: 0.4585 - ETA: 6s - loss: 8.6366 - acc: 0.4588 - ETA: 6s - loss: 8.6178 - acc: 0.4601 - ETA: 6s - loss: 8.6073 - acc: 0.4608 - ETA: 6s - loss: 8.6195 - acc: 0.4602 - ETA: 6s - loss: 8.6095 - acc: 0.4609 - ETA: 6s - loss: 8.6141 - acc: 0.4607 - ETA: 6s - loss: 8.6256 - acc: 0.4601 - ETA: 6s - loss: 8.6162 - acc: 0.4603 - ETA: 6s - loss: 8.5987 - acc: 0.4614 - ETA: 6s - loss: 8.5922 - acc: 0.4617 - ETA: 5s - loss: 8.5579 - acc: 0.4635 - ETA: 5s - loss: 8.5763 - acc: 0.4621 - ETA: 5s - loss: 8.5681 - acc: 0.4627 - ETA: 5s - loss: 8.5728 - acc: 0.4625 - ETA: 5s - loss: 8.5898 - acc: 0.4615 - ETA: 5s - loss: 8.5882 - acc: 0.4614 - ETA: 5s - loss: 8.6046 - acc: 0.4604 - ETA: 5s - loss: 8.5966 - acc: 0.4610 - ETA: 5s - loss: 8.5907 - acc: 0.4612 - ETA: 5s - loss: 8.5716 - acc: 0.4625 - ETA: 5s - loss: 8.5601 - acc: 0.4630 - ETA: 5s - loss: 8.5256 - acc: 0.4649 - ETA: 5s - loss: 8.5303 - acc: 0.4647 - ETA: 5s - loss: 8.5186 - acc: 0.4655 - ETA: 5s - loss: 8.5022 - acc: 0.4663 - ETA: 5s - loss: 8.5179 - acc: 0.4651 - ETA: 4s - loss: 8.4912 - acc: 0.4669 - ETA: 4s - loss: 8.5064 - acc: 0.4660 - ETA: 4s - loss: 8.5162 - acc: 0.4655 - ETA: 4s - loss: 8.5206 - acc: 0.4653 - ETA: 4s - loss: 8.5261 - acc: 0.4645 - ETA: 4s - loss: 8.5115 - acc: 0.4652 - ETA: 4s - loss: 8.4779 - acc: 0.4672 - ETA: 4s - loss: 8.4921 - acc: 0.4664 - ETA: 4s - loss: 8.4823 - acc: 0.4671 - ETA: 4s - loss: 8.4539 - acc: 0.4689 - ETA: 4s - loss: 8.4610 - acc: 0.4686 - ETA: 4s - loss: 8.4610 - acc: 0.4686 - ETA: 4s - loss: 8.4657 - acc: 0.4684 - ETA: 4s - loss: 8.4701 - acc: 0.4682 - ETA: 4s - loss: 8.4612 - acc: 0.4689 - ETA: 4s - loss: 8.4710 - acc: 0.4681 - ETA: 4s - loss: 8.4724 - acc: 0.4679 - ETA: 3s - loss: 8.4688 - acc: 0.4680 - ETA: 3s - loss: 8.4772 - acc: 0.4675 - ETA: 3s - loss: 8.4603 - acc: 0.4687 - ETA: 3s - loss: 8.4566 - acc: 0.4687 - ETA: 3s - loss: 8.4689 - acc: 0.4680 - ETA: 3s - loss: 8.4769 - acc: 0.4676 - ETA: 3s - loss: 8.4649 - acc: 0.4684 - ETA: 3s - loss: 8.4535 - acc: 0.4690 - ETA: 3s - loss: 8.4497 - acc: 0.4693 - ETA: 3s - loss: 8.4576 - acc: 0.4688 - ETA: 3s - loss: 8.4511 - acc: 0.4689 - ETA: 3s - loss: 8.4337 - acc: 0.4697 - ETA: 3s - loss: 8.4378 - acc: 0.4695 - ETA: 3s - loss: 8.4196 - acc: 0.4707 - ETA: 3s - loss: 8.4352 - acc: 0.4696 - ETA: 3s - loss: 8.4207 - acc: 0.4705 - ETA: 3s - loss: 8.4180 - acc: 0.4706 - ETA: 3s - loss: 8.4112 - acc: 0.4711 - ETA: 2s - loss: 8.4143 - acc: 0.4709 - ETA: 2s - loss: 8.4243 - acc: 0.4703 - ETA: 2s - loss: 8.4360 - acc: 0.4694 - ETA: 2s - loss: 8.4398 - acc: 0.4693 - ETA: 2s - loss: 8.4193 - acc: 0.4706 - ETA: 2s - loss: 8.4333 - acc: 0.4698 - ETA: 2s - loss: 8.4370 - acc: 0.4696 - ETA: 2s - loss: 8.4339 - acc: 0.4699 - ETA: 2s - loss: 8.4376 - acc: 0.4697 - ETA: 2s - loss: 8.4179 - acc: 0.4710 - ETA: 2s - loss: 8.4218 - acc: 0.4706 - ETA: 2s - loss: 8.4188 - acc: 0.4709 - ETA: 2s - loss: 8.4331 - acc: 0.4699 - ETA: 2s - loss: 8.4205 - acc: 0.4707 - ETA: 2s - loss: 8.4050 - acc: 0.4717 - ETA: 2s - loss: 8.3992 - acc: 0.4722 - ETA: 2s - loss: 8.3841 - acc: 0.4732 - ETA: 2s - loss: 8.3910 - acc: 0.4728 - ETA: 1s - loss: 8.3797 - acc: 0.4734 - ETA: 1s - loss: 8.3773 - acc: 0.4736 - ETA: 1s - loss: 8.3658 - acc: 0.4743 - ETA: 1s - loss: 8.3787 - acc: 0.4736 - ETA: 1s - loss: 8.3733 - acc: 0.4740 - ETA: 1s - loss: 8.3651 - acc: 0.4745 - ETA: 1s - loss: 8.3546 - acc: 0.4751 - ETA: 1s - loss: 8.3613 - acc: 0.4747 - ETA: 1s - loss: 8.3565 - acc: 0.4749 - ETA: 1s - loss: 8.3489 - acc: 0.4753 - ETA: 1s - loss: 8.3589 - acc: 0.4746 - ETA: 1s - loss: 8.3596 - acc: 0.4746 - ETA: 1s - loss: 8.3689 - acc: 0.4740 - ETA: 1s - loss: 8.3671 - acc: 0.4740 - ETA: 1s - loss: 8.3705 - acc: 0.4739 - ETA: 1s - loss: 8.3653 - acc: 0.4739 - ETA: 1s - loss: 8.3687 - acc: 0.4737 - ETA: 1s - loss: 8.3639 - acc: 0.4741 - ETA: 0s - loss: 8.3728 - acc: 0.4736 - ETA: 0s - loss: 8.3828 - acc: 0.4729 - ETA: 0s - loss: 8.3812 - acc: 0.4729 - ETA: 0s - loss: 8.3923 - acc: 0.4723 - ETA: 0s - loss: 8.3954 - acc: 0.4721 - ETA: 0s - loss: 8.4076 - acc: 0.4712 - ETA: 0s - loss: 8.4184 - acc: 0.4706 - ETA: 0s - loss: 8.4213 - acc: 0.4704 - ETA: 0s - loss: 8.4114 - acc: 0.4709 - ETA: 0s - loss: 8.4219 - acc: 0.4703 - ETA: 0s - loss: 8.4251 - acc: 0.4700 - ETA: 0s - loss: 8.4228 - acc: 0.4702 - ETA: 0s - loss: 8.4332 - acc: 0.4696 - ETA: 0s - loss: 8.4312 - acc: 0.4697 - ETA: 0s - loss: 8.4215 - acc: 0.4703 - ETA: 0s - loss: 8.4390 - acc: 0.4693 - ETA: 0s - loss: 8.4318 - acc: 0.4698 - ETA: 0s - loss: 8.4320 - acc: 0.4698 - ETA: 0s - loss: 8.4298 - acc: 0.4700Epoch 00013: val_loss improved from 9.10444 to 9.09969, saving model to saved_models/weights.best.VGG16.hdf5
6680/6680 [==============================] - 9s - loss: 8.4224 - acc: 0.4702 - val_loss: 9.0997 - val_acc: 0.3605
Epoch 15/20
6640/6680 [============================>.] - ETA: 6s - loss: 10.4769 - acc: 0.3500 - ETA: 7s - loss: 9.9481 - acc: 0.3833  - ETA: 8s - loss: 9.1954 - acc: 0.4300 - ETA: 8s - loss: 9.2162 - acc: 0.4286 - ETA: 8s - loss: 8.7800 - acc: 0.4556 - ETA: 8s - loss: 9.0153 - acc: 0.4409 - ETA: 8s - loss: 9.0542 - acc: 0.4385 - ETA: 8s - loss: 8.7131 - acc: 0.4567 - ETA: 8s - loss: 8.7784 - acc: 0.4529 - ETA: 8s - loss: 8.7451 - acc: 0.4553 - ETA: 8s - loss: 8.6419 - acc: 0.4619 - ETA: 8s - loss: 8.5568 - acc: 0.4674 - ETA: 8s - loss: 8.4203 - acc: 0.4760 - ETA: 8s - loss: 8.4831 - acc: 0.4722 - ETA: 8s - loss: 8.4816 - acc: 0.4724 - ETA: 8s - loss: 8.4544 - acc: 0.4742 - ETA: 7s - loss: 8.3933 - acc: 0.4758 - ETA: 7s - loss: 8.3974 - acc: 0.4757 - ETA: 7s - loss: 8.4446 - acc: 0.4730 - ETA: 7s - loss: 8.4869 - acc: 0.4705 - ETA: 7s - loss: 8.4661 - acc: 0.4720 - ETA: 7s - loss: 8.4284 - acc: 0.4744 - ETA: 7s - loss: 8.3624 - acc: 0.4767 - ETA: 7s - loss: 8.3666 - acc: 0.4766 - ETA: 7s - loss: 8.4199 - acc: 0.4735 - ETA: 7s - loss: 8.4058 - acc: 0.4745 - ETA: 7s - loss: 8.4079 - acc: 0.4745 - ETA: 7s - loss: 8.4100 - acc: 0.4745 - ETA: 7s - loss: 8.3553 - acc: 0.4781 - ETA: 7s - loss: 8.3726 - acc: 0.4771 - ETA: 7s - loss: 8.4162 - acc: 0.4738 - ETA: 7s - loss: 8.3921 - acc: 0.4754 - ETA: 7s - loss: 8.3441 - acc: 0.4785 - ETA: 7s - loss: 8.3718 - acc: 0.4769 - ETA: 6s - loss: 8.3634 - acc: 0.4768 - ETA: 6s - loss: 8.3677 - acc: 0.4754 - ETA: 6s - loss: 8.4081 - acc: 0.4726 - ETA: 6s - loss: 8.3775 - acc: 0.4747 - ETA: 6s - loss: 8.4218 - acc: 0.4721 - ETA: 6s - loss: 8.4432 - acc: 0.4709 - ETA: 6s - loss: 8.4167 - acc: 0.4722 - ETA: 6s - loss: 8.4081 - acc: 0.4729 - ETA: 6s - loss: 8.3911 - acc: 0.4735 - ETA: 6s - loss: 8.4393 - acc: 0.4707 - ETA: 6s - loss: 8.4035 - acc: 0.4730 - ETA: 6s - loss: 8.4049 - acc: 0.4731 - ETA: 6s - loss: 8.4149 - acc: 0.4726 - ETA: 6s - loss: 8.3989 - acc: 0.4737 - ETA: 6s - loss: 8.3919 - acc: 0.4742 - ETA: 6s - loss: 8.4015 - acc: 0.4737 - ETA: 6s - loss: 8.4269 - acc: 0.4723 - ETA: 6s - loss: 8.3728 - acc: 0.4757 - ETA: 6s - loss: 8.3828 - acc: 0.4748 - ETA: 5s - loss: 8.3842 - acc: 0.4748 - ETA: 5s - loss: 8.4044 - acc: 0.4734 - ETA: 5s - loss: 8.3839 - acc: 0.4748 - ETA: 5s - loss: 8.3424 - acc: 0.4774 - ETA: 5s - loss: 8.3446 - acc: 0.4774 - ETA: 5s - loss: 8.3259 - acc: 0.4786 - ETA: 5s - loss: 8.3554 - acc: 0.4769 - ETA: 5s - loss: 8.3840 - acc: 0.4752 - ETA: 5s - loss: 8.3722 - acc: 0.4760 - ETA: 5s - loss: 8.3891 - acc: 0.4748 - ETA: 5s - loss: 8.4040 - acc: 0.4736 - ETA: 5s - loss: 8.3987 - acc: 0.4740 - ETA: 5s - loss: 8.4059 - acc: 0.4737 - ETA: 5s - loss: 8.4128 - acc: 0.4733 - ETA: 5s - loss: 8.4315 - acc: 0.4722 - ETA: 5s - loss: 8.4003 - acc: 0.4739 - ETA: 5s - loss: 8.3839 - acc: 0.4750 - ETA: 5s - loss: 8.3811 - acc: 0.4750 - ETA: 5s - loss: 8.3655 - acc: 0.4760 - ETA: 4s - loss: 8.3908 - acc: 0.4743 - ETA: 4s - loss: 8.3918 - acc: 0.4743 - ETA: 4s - loss: 8.3823 - acc: 0.4747 - ETA: 4s - loss: 8.3740 - acc: 0.4750 - ETA: 4s - loss: 8.3652 - acc: 0.4753 - ETA: 4s - loss: 8.3799 - acc: 0.4745 - ETA: 4s - loss: 8.3759 - acc: 0.4748 - ETA: 4s - loss: 8.3552 - acc: 0.4762 - ETA: 4s - loss: 8.3665 - acc: 0.4756 - ETA: 4s - loss: 8.3871 - acc: 0.4744 - ETA: 4s - loss: 8.3700 - acc: 0.4753 - ETA: 4s - loss: 8.3675 - acc: 0.4750 - ETA: 4s - loss: 8.3733 - acc: 0.4747 - ETA: 4s - loss: 8.3836 - acc: 0.4741 - ETA: 4s - loss: 8.3799 - acc: 0.4744 - ETA: 4s - loss: 8.3854 - acc: 0.4742 - ETA: 4s - loss: 8.3824 - acc: 0.4742 - ETA: 3s - loss: 8.3931 - acc: 0.4734 - ETA: 3s - loss: 8.3763 - acc: 0.4745 - ETA: 3s - loss: 8.3686 - acc: 0.4750 - ETA: 3s - loss: 8.3525 - acc: 0.4761 - ETA: 3s - loss: 8.3537 - acc: 0.4761 - ETA: 3s - loss: 8.3714 - acc: 0.4750 - ETA: 3s - loss: 8.3682 - acc: 0.4753 - ETA: 3s - loss: 8.3568 - acc: 0.4760 - ETA: 3s - loss: 8.3620 - acc: 0.4758 - ETA: 3s - loss: 8.3670 - acc: 0.4755 - ETA: 3s - loss: 8.3603 - acc: 0.4757 - ETA: 3s - loss: 8.3813 - acc: 0.4745 - ETA: 3s - loss: 8.3978 - acc: 0.4735 - ETA: 3s - loss: 8.4370 - acc: 0.4712 - ETA: 3s - loss: 8.4380 - acc: 0.4710 - ETA: 3s - loss: 8.4344 - acc: 0.4712 - ETA: 3s - loss: 8.4424 - acc: 0.4706 - ETA: 3s - loss: 8.4427 - acc: 0.4706 - ETA: 3s - loss: 8.4355 - acc: 0.4711 - ETA: 3s - loss: 8.4343 - acc: 0.4711 - ETA: 2s - loss: 8.4310 - acc: 0.4714 - ETA: 2s - loss: 8.4457 - acc: 0.4705 - ETA: 2s - loss: 8.4458 - acc: 0.4706 - ETA: 2s - loss: 8.4477 - acc: 0.4704 - ETA: 2s - loss: 8.4419 - acc: 0.4707 - ETA: 2s - loss: 8.4383 - acc: 0.4707 - ETA: 2s - loss: 8.4350 - acc: 0.4709 - ETA: 2s - loss: 8.4114 - acc: 0.4725 - ETA: 2s - loss: 8.4114 - acc: 0.4725 - ETA: 2s - loss: 8.4079 - acc: 0.4726 - ETA: 2s - loss: 8.3918 - acc: 0.4737 - ETA: 2s - loss: 8.3860 - acc: 0.4739 - ETA: 2s - loss: 8.3771 - acc: 0.4743 - ETA: 2s - loss: 8.3876 - acc: 0.4737 - ETA: 2s - loss: 8.3942 - acc: 0.4731 - ETA: 2s - loss: 8.4000 - acc: 0.4727 - ETA: 2s - loss: 8.4004 - acc: 0.4723 - ETA: 2s - loss: 8.4104 - acc: 0.4718 - ETA: 2s - loss: 8.3961 - acc: 0.4726 - ETA: 1s - loss: 8.3977 - acc: 0.4724 - ETA: 1s - loss: 8.3944 - acc: 0.4726 - ETA: 1s - loss: 8.3827 - acc: 0.4734 - ETA: 1s - loss: 8.3894 - acc: 0.4730 - ETA: 1s - loss: 8.3781 - acc: 0.4736 - ETA: 1s - loss: 8.3789 - acc: 0.4734 - ETA: 1s - loss: 8.3766 - acc: 0.4736 - ETA: 1s - loss: 8.3938 - acc: 0.4725 - ETA: 1s - loss: 8.4002 - acc: 0.4722 - ETA: 1s - loss: 8.3989 - acc: 0.4722 - ETA: 1s - loss: 8.4080 - acc: 0.4717 - ETA: 1s - loss: 8.4031 - acc: 0.4719 - ETA: 1s - loss: 8.3922 - acc: 0.4726 - ETA: 1s - loss: 8.3934 - acc: 0.4725 - ETA: 1s - loss: 8.3859 - acc: 0.4728 - ETA: 1s - loss: 8.3726 - acc: 0.4737 - ETA: 1s - loss: 8.3823 - acc: 0.4729 - ETA: 1s - loss: 8.3693 - acc: 0.4737 - ETA: 1s - loss: 8.3782 - acc: 0.4731 - ETA: 0s - loss: 8.3761 - acc: 0.4732 - ETA: 0s - loss: 8.3931 - acc: 0.4721 - ETA: 0s - loss: 8.3987 - acc: 0.4715 - ETA: 0s - loss: 8.3946 - acc: 0.4717 - ETA: 0s - loss: 8.3820 - acc: 0.4724 - ETA: 0s - loss: 8.3747 - acc: 0.4729 - ETA: 0s - loss: 8.3781 - acc: 0.4726 - ETA: 0s - loss: 8.3864 - acc: 0.4721 - ETA: 0s - loss: 8.3860 - acc: 0.4721 - ETA: 0s - loss: 8.3786 - acc: 0.4723 - ETA: 0s - loss: 8.3823 - acc: 0.4720 - ETA: 0s - loss: 8.3744 - acc: 0.4723 - ETA: 0s - loss: 8.3724 - acc: 0.4725 - ETA: 0s - loss: 8.3667 - acc: 0.4728 - ETA: 0s - loss: 8.3657 - acc: 0.4729 - ETA: 0s - loss: 8.3737 - acc: 0.4724 - ETA: 0s - loss: 8.3779 - acc: 0.4721 - ETA: 0s - loss: 8.3825 - acc: 0.4718Epoch 00014: val_loss did not improve
6680/6680 [==============================] - 9s - loss: 8.3760 - acc: 0.4722 - val_loss: 9.2140 - val_acc: 0.3581
Epoch 16/20
6660/6680 [============================>.] - ETA: 6s - loss: 8.0408 - acc: 0.5000 - ETA: 6s - loss: 8.4915 - acc: 0.4500 - ETA: 7s - loss: 9.4238 - acc: 0.4000 - ETA: 7s - loss: 8.5983 - acc: 0.4500 - ETA: 7s - loss: 8.2587 - acc: 0.4650 - ETA: 7s - loss: 8.4270 - acc: 0.4583 - ETA: 7s - loss: 8.3755 - acc: 0.4643 - ETA: 7s - loss: 8.2856 - acc: 0.4719 - ETA: 7s - loss: 8.3739 - acc: 0.4611 - ETA: 7s - loss: 8.4819 - acc: 0.4550 - ETA: 7s - loss: 8.6780 - acc: 0.4432 - ETA: 7s - loss: 8.5929 - acc: 0.4500 - ETA: 7s - loss: 8.5992 - acc: 0.4481 - ETA: 7s - loss: 8.6473 - acc: 0.4464 - ETA: 7s - loss: 8.6652 - acc: 0.4450 - ETA: 7s - loss: 8.7281 - acc: 0.4422 - ETA: 7s - loss: 8.6335 - acc: 0.4485 - ETA: 7s - loss: 8.6464 - acc: 0.4486 - ETA: 7s - loss: 8.6580 - acc: 0.4487 - ETA: 7s - loss: 8.6282 - acc: 0.4512 - ETA: 7s - loss: 8.6971 - acc: 0.4476 - ETA: 7s - loss: 8.7413 - acc: 0.4455 - ETA: 7s - loss: 8.5715 - acc: 0.4565 - ETA: 7s - loss: 8.4999 - acc: 0.4615 - ETA: 7s - loss: 8.3709 - acc: 0.4690 - ETA: 7s - loss: 8.2902 - acc: 0.4740 - ETA: 7s - loss: 8.2488 - acc: 0.4769 - ETA: 7s - loss: 8.1607 - acc: 0.4821 - ETA: 7s - loss: 8.1863 - acc: 0.4802 - ETA: 7s - loss: 8.2092 - acc: 0.4792 - ETA: 6s - loss: 8.2182 - acc: 0.4782 - ETA: 6s - loss: 8.2362 - acc: 0.4773 - ETA: 6s - loss: 8.1834 - acc: 0.4803 - ETA: 6s - loss: 8.0894 - acc: 0.4860 - ETA: 6s - loss: 8.0908 - acc: 0.4857 - ETA: 6s - loss: 8.1236 - acc: 0.4840 - ETA: 6s - loss: 8.1289 - acc: 0.4831 - ETA: 6s - loss: 8.1695 - acc: 0.4809 - ETA: 6s - loss: 8.1977 - acc: 0.4795 - ETA: 6s - loss: 8.2194 - acc: 0.4775 - ETA: 6s - loss: 8.2357 - acc: 0.4762 - ETA: 6s - loss: 8.2315 - acc: 0.4768 - ETA: 6s - loss: 8.2275 - acc: 0.4773 - ETA: 6s - loss: 8.1906 - acc: 0.4795 - ETA: 6s - loss: 8.1110 - acc: 0.4839 - ETA: 6s - loss: 8.1273 - acc: 0.4821 - ETA: 6s - loss: 8.1604 - acc: 0.4803 - ETA: 6s - loss: 8.1754 - acc: 0.4797 - ETA: 6s - loss: 8.1674 - acc: 0.4801 - ETA: 6s - loss: 8.1813 - acc: 0.4795 - ETA: 6s - loss: 8.2346 - acc: 0.4760 - ETA: 5s - loss: 8.2892 - acc: 0.4726 - ETA: 5s - loss: 8.2891 - acc: 0.4726 - ETA: 5s - loss: 8.3072 - acc: 0.4718 - ETA: 5s - loss: 8.3257 - acc: 0.4700 - ETA: 5s - loss: 8.3283 - acc: 0.4701 - ETA: 5s - loss: 8.3238 - acc: 0.4706 - ETA: 5s - loss: 8.3054 - acc: 0.4720 - ETA: 5s - loss: 8.2944 - acc: 0.4729 - ETA: 5s - loss: 8.2501 - acc: 0.4758 - ETA: 5s - loss: 8.2222 - acc: 0.4775 - ETA: 5s - loss: 8.2261 - acc: 0.4774 - ETA: 5s - loss: 8.1978 - acc: 0.4794 - ETA: 5s - loss: 8.1768 - acc: 0.4809 - ETA: 5s - loss: 8.1812 - acc: 0.4808 - ETA: 5s - loss: 8.2044 - acc: 0.4792 - ETA: 5s - loss: 8.2023 - acc: 0.4795 - ETA: 5s - loss: 8.2099 - acc: 0.4790 - ETA: 5s - loss: 8.2486 - acc: 0.4768 - ETA: 5s - loss: 8.2318 - acc: 0.4779 - ETA: 5s - loss: 8.2138 - acc: 0.4782 - ETA: 4s - loss: 8.1950 - acc: 0.4795 - ETA: 4s - loss: 8.1711 - acc: 0.4812 - ETA: 4s - loss: 8.1440 - acc: 0.4824 - ETA: 4s - loss: 8.1485 - acc: 0.4820 - ETA: 4s - loss: 8.1580 - acc: 0.4816 - ETA: 4s - loss: 8.1912 - acc: 0.4795 - ETA: 4s - loss: 8.1973 - acc: 0.4788 - ETA: 4s - loss: 8.1957 - acc: 0.4791 - ETA: 4s - loss: 8.2004 - acc: 0.4788 - ETA: 4s - loss: 8.2100 - acc: 0.4781 - ETA: 4s - loss: 8.1885 - acc: 0.4796 - ETA: 4s - loss: 8.1870 - acc: 0.4798 - ETA: 4s - loss: 8.2083 - acc: 0.4783 - ETA: 4s - loss: 8.2302 - acc: 0.4771 - ETA: 4s - loss: 8.2283 - acc: 0.4773 - ETA: 4s - loss: 8.2078 - acc: 0.4787 - ETA: 4s - loss: 8.1878 - acc: 0.4801 - ETA: 4s - loss: 8.1975 - acc: 0.4795 - ETA: 4s - loss: 8.1862 - acc: 0.4800 - ETA: 4s - loss: 8.1964 - acc: 0.4791 - ETA: 3s - loss: 8.1994 - acc: 0.4791 - ETA: 3s - loss: 8.2197 - acc: 0.4780 - ETA: 3s - loss: 8.2268 - acc: 0.4777 - ETA: 3s - loss: 8.2250 - acc: 0.4779 - ETA: 3s - loss: 8.2305 - acc: 0.4771 - ETA: 3s - loss: 8.2412 - acc: 0.4765 - ETA: 3s - loss: 8.2193 - acc: 0.4778 - ETA: 3s - loss: 8.2019 - acc: 0.4788 - ETA: 3s - loss: 8.1764 - acc: 0.4805 - ETA: 3s - loss: 8.1912 - acc: 0.4797 - ETA: 3s - loss: 8.1953 - acc: 0.4794 - ETA: 3s - loss: 8.2117 - acc: 0.4784 - ETA: 3s - loss: 8.2296 - acc: 0.4774 - ETA: 3s - loss: 8.2165 - acc: 0.4783 - ETA: 3s - loss: 8.2340 - acc: 0.4774 - ETA: 3s - loss: 8.2423 - acc: 0.4769 - ETA: 3s - loss: 8.2303 - acc: 0.4773 - ETA: 3s - loss: 8.2305 - acc: 0.4773 - ETA: 3s - loss: 8.2241 - acc: 0.4775 - ETA: 2s - loss: 8.2261 - acc: 0.4775 - ETA: 2s - loss: 8.2498 - acc: 0.4761 - ETA: 2s - loss: 8.2588 - acc: 0.4757 - ETA: 2s - loss: 8.2437 - acc: 0.4765 - ETA: 2s - loss: 8.2388 - acc: 0.4767 - ETA: 2s - loss: 8.2448 - acc: 0.4763 - ETA: 2s - loss: 8.2432 - acc: 0.4765 - ETA: 2s - loss: 8.2350 - acc: 0.4771 - ETA: 2s - loss: 8.2301 - acc: 0.4775 - ETA: 2s - loss: 8.2314 - acc: 0.4775 - ETA: 2s - loss: 8.2242 - acc: 0.4779 - ETA: 2s - loss: 8.2098 - acc: 0.4787 - ETA: 2s - loss: 8.2151 - acc: 0.4785 - ETA: 2s - loss: 8.2107 - acc: 0.4788 - ETA: 2s - loss: 8.2035 - acc: 0.4792 - ETA: 2s - loss: 8.2215 - acc: 0.4782 - ETA: 2s - loss: 8.1951 - acc: 0.4797 - ETA: 2s - loss: 8.1878 - acc: 0.4803 - ETA: 2s - loss: 8.1868 - acc: 0.4804 - ETA: 1s - loss: 8.1889 - acc: 0.4804 - ETA: 1s - loss: 8.1868 - acc: 0.4803 - ETA: 1s - loss: 8.1806 - acc: 0.4807 - ETA: 1s - loss: 8.2011 - acc: 0.4793 - ETA: 1s - loss: 8.2030 - acc: 0.4793 - ETA: 1s - loss: 8.2035 - acc: 0.4793 - ETA: 1s - loss: 8.2114 - acc: 0.4789 - ETA: 1s - loss: 8.2073 - acc: 0.4792 - ETA: 1s - loss: 8.2042 - acc: 0.4792 - ETA: 1s - loss: 8.2061 - acc: 0.4791 - ETA: 1s - loss: 8.2137 - acc: 0.4788 - ETA: 1s - loss: 8.2063 - acc: 0.4791 - ETA: 1s - loss: 8.2308 - acc: 0.4776 - ETA: 1s - loss: 8.2358 - acc: 0.4771 - ETA: 1s - loss: 8.2537 - acc: 0.4760 - ETA: 1s - loss: 8.2552 - acc: 0.4759 - ETA: 1s - loss: 8.2577 - acc: 0.4758 - ETA: 1s - loss: 8.2591 - acc: 0.4758 - ETA: 0s - loss: 8.2795 - acc: 0.4746 - ETA: 0s - loss: 8.2698 - acc: 0.4749 - ETA: 0s - loss: 8.2711 - acc: 0.4749 - ETA: 0s - loss: 8.2704 - acc: 0.4749 - ETA: 0s - loss: 8.2718 - acc: 0.4749 - ETA: 0s - loss: 8.2734 - acc: 0.4748 - ETA: 0s - loss: 8.2625 - acc: 0.4754 - ETA: 0s - loss: 8.2675 - acc: 0.4751 - ETA: 0s - loss: 8.2767 - acc: 0.4744 - ETA: 0s - loss: 8.2676 - acc: 0.4751 - ETA: 0s - loss: 8.2642 - acc: 0.4751 - ETA: 0s - loss: 8.2781 - acc: 0.4743 - ETA: 0s - loss: 8.2676 - acc: 0.4749 - ETA: 0s - loss: 8.2813 - acc: 0.4741 - ETA: 0s - loss: 8.2799 - acc: 0.4743 - ETA: 0s - loss: 8.2669 - acc: 0.4751 - ETA: 0s - loss: 8.2705 - acc: 0.4749 - ETA: 0s - loss: 8.2619 - acc: 0.4755 - ETA: 0s - loss: 8.2587 - acc: 0.4757Epoch 00015: val_loss did not improve
6680/6680 [==============================] - 9s - loss: 8.2565 - acc: 0.4756 - val_loss: 9.1195 - val_acc: 0.3629
Epoch 17/20
6640/6680 [============================>.] - ETA: 6s - loss: 8.0596 - acc: 0.5000 - ETA: 7s - loss: 8.6100 - acc: 0.4667 - ETA: 7s - loss: 8.5528 - acc: 0.4700 - ETA: 7s - loss: 9.0528 - acc: 0.4357 - ETA: 7s - loss: 8.4053 - acc: 0.4722 - ETA: 8s - loss: 8.7839 - acc: 0.4500 - ETA: 8s - loss: 8.6724 - acc: 0.4577 - ETA: 8s - loss: 8.4295 - acc: 0.4733 - ETA: 8s - loss: 8.4334 - acc: 0.4735 - ETA: 8s - loss: 8.3623 - acc: 0.4763 - ETA: 8s - loss: 8.5845 - acc: 0.4595 - ETA: 8s - loss: 8.6441 - acc: 0.4565 - ETA: 8s - loss: 8.5328 - acc: 0.4640 - ETA: 8s - loss: 8.4680 - acc: 0.4685 - ETA: 7s - loss: 8.3009 - acc: 0.4793 - ETA: 7s - loss: 8.2967 - acc: 0.4790 - ETA: 7s - loss: 8.2095 - acc: 0.4848 - ETA: 7s - loss: 8.2243 - acc: 0.4843 - ETA: 7s - loss: 8.2415 - acc: 0.4824 - ETA: 7s - loss: 8.2528 - acc: 0.4821 - ETA: 7s - loss: 8.3042 - acc: 0.4780 - ETA: 7s - loss: 8.1804 - acc: 0.4860 - ETA: 7s - loss: 8.1584 - acc: 0.4867 - ETA: 7s - loss: 8.2228 - acc: 0.4830 - ETA: 7s - loss: 8.2639 - acc: 0.4806 - ETA: 7s - loss: 8.1927 - acc: 0.4853 - ETA: 7s - loss: 8.1420 - acc: 0.4887 - ETA: 7s - loss: 8.1683 - acc: 0.4873 - ETA: 7s - loss: 8.1272 - acc: 0.4895 - ETA: 7s - loss: 8.1662 - acc: 0.4873 - ETA: 7s - loss: 8.1637 - acc: 0.4869 - ETA: 7s - loss: 8.1886 - acc: 0.4849 - ETA: 7s - loss: 8.1722 - acc: 0.4862 - ETA: 7s - loss: 8.1691 - acc: 0.4866 - ETA: 7s - loss: 8.1308 - acc: 0.4891 - ETA: 7s - loss: 8.1061 - acc: 0.4908 - ETA: 7s - loss: 8.1182 - acc: 0.4897 - ETA: 6s - loss: 8.1177 - acc: 0.4893 - ETA: 6s - loss: 8.0640 - acc: 0.4929 - ETA: 6s - loss: 8.0231 - acc: 0.4956 - ETA: 6s - loss: 8.0844 - acc: 0.4914 - ETA: 6s - loss: 8.0943 - acc: 0.4904 - ETA: 6s - loss: 8.0671 - acc: 0.4918 - ETA: 6s - loss: 8.1229 - acc: 0.4885 - ETA: 6s - loss: 8.1235 - acc: 0.4882 - ETA: 6s - loss: 8.1404 - acc: 0.4868 - ETA: 6s - loss: 8.1150 - acc: 0.4882 - ETA: 6s - loss: 8.1819 - acc: 0.4842 - ETA: 6s - loss: 8.1722 - acc: 0.4845 - ETA: 6s - loss: 8.1944 - acc: 0.4833 - ETA: 6s - loss: 8.2077 - acc: 0.4827 - ETA: 6s - loss: 8.1502 - acc: 0.4864 - ETA: 6s - loss: 8.1638 - acc: 0.4857 - ETA: 6s - loss: 8.1619 - acc: 0.4860 - ETA: 6s - loss: 8.1600 - acc: 0.4862 - ETA: 6s - loss: 8.1582 - acc: 0.4865 - ETA: 5s - loss: 8.0858 - acc: 0.4907 - ETA: 5s - loss: 8.0864 - acc: 0.4904 - ETA: 5s - loss: 8.1066 - acc: 0.4893 - ETA: 5s - loss: 8.1194 - acc: 0.4887 - ETA: 5s - loss: 8.1462 - acc: 0.4868 - ETA: 5s - loss: 8.1441 - acc: 0.4871 - ETA: 5s - loss: 8.1492 - acc: 0.4869 - ETA: 5s - loss: 8.1543 - acc: 0.4867 - ETA: 5s - loss: 8.1469 - acc: 0.4873 - ETA: 5s - loss: 8.1232 - acc: 0.4886 - ETA: 5s - loss: 8.1055 - acc: 0.4896 - ETA: 5s - loss: 8.1345 - acc: 0.4879 - ETA: 5s - loss: 8.1220 - acc: 0.4888 - ETA: 5s - loss: 8.1166 - acc: 0.4889 - ETA: 5s - loss: 8.1049 - acc: 0.4894 - ETA: 5s - loss: 8.1043 - acc: 0.4896 - ETA: 5s - loss: 8.1368 - acc: 0.4877 - ETA: 4s - loss: 8.1857 - acc: 0.4841 - ETA: 4s - loss: 8.2058 - acc: 0.4827 - ETA: 4s - loss: 8.1935 - acc: 0.4832 - ETA: 4s - loss: 8.1742 - acc: 0.4844 - ETA: 4s - loss: 8.1892 - acc: 0.4833 - ETA: 4s - loss: 8.1790 - acc: 0.4835 - ETA: 4s - loss: 8.1735 - acc: 0.4838 - ETA: 4s - loss: 8.1773 - acc: 0.4833 - ETA: 4s - loss: 8.1808 - acc: 0.4832 - ETA: 4s - loss: 8.2036 - acc: 0.4819 - ETA: 4s - loss: 8.1863 - acc: 0.4827 - ETA: 4s - loss: 8.1850 - acc: 0.4829 - ETA: 4s - loss: 8.2070 - acc: 0.4817 - ETA: 4s - loss: 8.1914 - acc: 0.4828 - ETA: 4s - loss: 8.1722 - acc: 0.4838 - ETA: 4s - loss: 8.1582 - acc: 0.4846 - ETA: 4s - loss: 8.1318 - acc: 0.4858 - ETA: 4s - loss: 8.1532 - acc: 0.4846 - ETA: 4s - loss: 8.1654 - acc: 0.4840 - ETA: 3s - loss: 8.1601 - acc: 0.4844 - ETA: 3s - loss: 8.1634 - acc: 0.4843 - ETA: 3s - loss: 8.1581 - acc: 0.4847 - ETA: 3s - loss: 8.1572 - acc: 0.4849 - ETA: 3s - loss: 8.1566 - acc: 0.4848 - ETA: 3s - loss: 8.1433 - acc: 0.4857 - ETA: 3s - loss: 8.1436 - acc: 0.4854 - ETA: 3s - loss: 8.1360 - acc: 0.4858 - ETA: 3s - loss: 8.1557 - acc: 0.4844 - ETA: 3s - loss: 8.1825 - acc: 0.4828 - ETA: 3s - loss: 8.1813 - acc: 0.4830 - ETA: 3s - loss: 8.1782 - acc: 0.4829 - ETA: 3s - loss: 8.2040 - acc: 0.4813 - ETA: 3s - loss: 8.2179 - acc: 0.4806 - ETA: 3s - loss: 8.2278 - acc: 0.4800 - ETA: 3s - loss: 8.2338 - acc: 0.4798 - ETA: 3s - loss: 8.2470 - acc: 0.4790 - ETA: 3s - loss: 8.2308 - acc: 0.4799 - ETA: 3s - loss: 8.2476 - acc: 0.4790 - ETA: 3s - loss: 8.2712 - acc: 0.4776 - ETA: 2s - loss: 8.2586 - acc: 0.4784 - ETA: 2s - loss: 8.2648 - acc: 0.4780 - ETA: 2s - loss: 8.2630 - acc: 0.4782 - ETA: 2s - loss: 8.2578 - acc: 0.4786 - ETA: 2s - loss: 8.2561 - acc: 0.4788 - ETA: 2s - loss: 8.2683 - acc: 0.4779 - ETA: 2s - loss: 8.2639 - acc: 0.4781 - ETA: 2s - loss: 8.2487 - acc: 0.4791 - ETA: 2s - loss: 8.2339 - acc: 0.4801 - ETA: 2s - loss: 8.2232 - acc: 0.4807 - ETA: 2s - loss: 8.2284 - acc: 0.4804 - ETA: 2s - loss: 8.2205 - acc: 0.4810 - ETA: 2s - loss: 8.2264 - acc: 0.4806 - ETA: 2s - loss: 8.2253 - acc: 0.4806 - ETA: 2s - loss: 8.2095 - acc: 0.4815 - ETA: 2s - loss: 8.2087 - acc: 0.4815 - ETA: 2s - loss: 8.2107 - acc: 0.4814 - ETA: 2s - loss: 8.1954 - acc: 0.4824 - ETA: 2s - loss: 8.2005 - acc: 0.4821 - ETA: 1s - loss: 8.1902 - acc: 0.4828 - ETA: 1s - loss: 8.1862 - acc: 0.4831 - ETA: 1s - loss: 8.1822 - acc: 0.4835 - ETA: 1s - loss: 8.1693 - acc: 0.4843 - ETA: 1s - loss: 8.1913 - acc: 0.4830 - ETA: 1s - loss: 8.1874 - acc: 0.4833 - ETA: 1s - loss: 8.1838 - acc: 0.4834 - ETA: 1s - loss: 8.1887 - acc: 0.4832 - ETA: 1s - loss: 8.1791 - acc: 0.4838 - ETA: 1s - loss: 8.1754 - acc: 0.4841 - ETA: 1s - loss: 8.1748 - acc: 0.4842 - ETA: 1s - loss: 8.1854 - acc: 0.4836 - ETA: 1s - loss: 8.1647 - acc: 0.4850 - ETA: 1s - loss: 8.1612 - acc: 0.4852 - ETA: 1s - loss: 8.1495 - acc: 0.4859 - ETA: 1s - loss: 8.1326 - acc: 0.4870 - ETA: 1s - loss: 8.1423 - acc: 0.4864 - ETA: 1s - loss: 8.1418 - acc: 0.4865 - ETA: 0s - loss: 8.1440 - acc: 0.4864 - ETA: 0s - loss: 8.1461 - acc: 0.4863 - ETA: 0s - loss: 8.1562 - acc: 0.4858 - ETA: 0s - loss: 8.1503 - acc: 0.4862 - ETA: 0s - loss: 8.1497 - acc: 0.4863 - ETA: 0s - loss: 8.1465 - acc: 0.4865 - ETA: 0s - loss: 8.1590 - acc: 0.4858 - ETA: 0s - loss: 8.1518 - acc: 0.4862 - ETA: 0s - loss: 8.1538 - acc: 0.4861 - ETA: 0s - loss: 8.1391 - acc: 0.4870 - ETA: 0s - loss: 8.1363 - acc: 0.4871 - ETA: 0s - loss: 8.1299 - acc: 0.4873 - ETA: 0s - loss: 8.1394 - acc: 0.4868 - ETA: 0s - loss: 8.1511 - acc: 0.4861 - ETA: 0s - loss: 8.1530 - acc: 0.4860 - ETA: 0s - loss: 8.1477 - acc: 0.4863 - ETA: 0s - loss: 8.1470 - acc: 0.4862 - ETA: 0s - loss: 8.1416 - acc: 0.4866Epoch 00016: val_loss improved from 9.09969 to 9.04338, saving model to saved_models/weights.best.VGG16.hdf5
6680/6680 [==============================] - 9s - loss: 8.1414 - acc: 0.4865 - val_loss: 9.0434 - val_acc: 0.3713
Epoch 18/20
6640/6680 [============================>.] - ETA: 6s - loss: 8.0596 - acc: 0.5000 - ETA: 7s - loss: 8.8787 - acc: 0.4333 - ETA: 9s - loss: 8.6738 - acc: 0.4500 - ETA: 9s - loss: 8.7770 - acc: 0.4417 - ETA: 9s - loss: 8.4990 - acc: 0.4625 - ETA: 9s - loss: 8.0092 - acc: 0.4950 - ETA: 9s - loss: 8.1691 - acc: 0.4833 - ETA: 9s - loss: 7.9842 - acc: 0.4964 - ETA: 9s - loss: 7.8932 - acc: 0.5031 - ETA: 9s - loss: 8.0908 - acc: 0.4917 - ETA: 9s - loss: 7.8861 - acc: 0.5050 - ETA: 9s - loss: 8.0117 - acc: 0.4977 - ETA: 8s - loss: 8.0829 - acc: 0.4938 - ETA: 8s - loss: 8.0821 - acc: 0.4942 - ETA: 8s - loss: 8.0288 - acc: 0.4946 - ETA: 8s - loss: 8.0745 - acc: 0.4917 - ETA: 8s - loss: 8.0735 - acc: 0.4922 - ETA: 8s - loss: 8.1728 - acc: 0.4853 - ETA: 8s - loss: 8.1256 - acc: 0.4875 - ETA: 8s - loss: 8.1910 - acc: 0.4829 - ETA: 8s - loss: 8.2659 - acc: 0.4787 - ETA: 8s - loss: 8.2177 - acc: 0.4821 - ETA: 8s - loss: 8.2713 - acc: 0.4784 - ETA: 8s - loss: 8.3496 - acc: 0.4739 - ETA: 8s - loss: 8.2886 - acc: 0.4771 - ETA: 8s - loss: 8.2634 - acc: 0.4790 - ETA: 8s - loss: 8.1942 - acc: 0.4837 - ETA: 7s - loss: 8.2516 - acc: 0.4796 - ETA: 7s - loss: 8.2177 - acc: 0.4804 - ETA: 7s - loss: 8.2263 - acc: 0.4802 - ETA: 7s - loss: 8.2347 - acc: 0.4800 - ETA: 7s - loss: 8.2168 - acc: 0.4815 - ETA: 7s - loss: 8.3126 - acc: 0.4758 - ETA: 7s - loss: 8.3057 - acc: 0.4765 - ETA: 7s - loss: 8.2748 - acc: 0.4787 - ETA: 7s - loss: 8.2576 - acc: 0.4800 - ETA: 7s - loss: 8.2409 - acc: 0.4812 - ETA: 7s - loss: 8.3020 - acc: 0.4764 - ETA: 7s - loss: 8.3066 - acc: 0.4763 - ETA: 7s - loss: 8.3315 - acc: 0.4750 - ETA: 7s - loss: 8.2946 - acc: 0.4775 - ETA: 7s - loss: 8.3057 - acc: 0.4768 - ETA: 7s - loss: 8.2847 - acc: 0.4768 - ETA: 7s - loss: 8.3452 - acc: 0.4733 - ETA: 6s - loss: 8.2929 - acc: 0.4767 - ETA: 6s - loss: 8.3594 - acc: 0.4728 - ETA: 6s - loss: 8.3439 - acc: 0.4734 - ETA: 6s - loss: 8.3294 - acc: 0.4745 - ETA: 6s - loss: 8.3491 - acc: 0.4734 - ETA: 6s - loss: 8.3411 - acc: 0.4740 - ETA: 6s - loss: 8.3194 - acc: 0.4755 - ETA: 6s - loss: 8.2985 - acc: 0.4770 - ETA: 6s - loss: 8.2939 - acc: 0.4774 - ETA: 6s - loss: 8.2895 - acc: 0.4778 - ETA: 6s - loss: 8.2330 - acc: 0.4815 - ETA: 6s - loss: 8.2126 - acc: 0.4827 - ETA: 6s - loss: 8.2028 - acc: 0.4835 - ETA: 6s - loss: 8.2500 - acc: 0.4807 - ETA: 6s - loss: 8.2954 - acc: 0.4780 - ETA: 6s - loss: 8.2982 - acc: 0.4780 - ETA: 6s - loss: 8.2948 - acc: 0.4779 - ETA: 6s - loss: 8.2909 - acc: 0.4783 - ETA: 5s - loss: 8.2938 - acc: 0.4782 - ETA: 5s - loss: 8.2901 - acc: 0.4786 - ETA: 5s - loss: 8.2550 - acc: 0.4809 - ETA: 5s - loss: 8.2267 - acc: 0.4827 - ETA: 5s - loss: 8.2181 - acc: 0.4833 - ETA: 5s - loss: 8.2449 - acc: 0.4817 - ETA: 5s - loss: 8.2302 - acc: 0.4824 - ETA: 5s - loss: 8.2079 - acc: 0.4830 - ETA: 5s - loss: 8.1668 - acc: 0.4846 - ETA: 5s - loss: 8.1766 - acc: 0.4842 - ETA: 5s - loss: 8.1559 - acc: 0.4847 - ETA: 5s - loss: 8.1271 - acc: 0.4866 - ETA: 5s - loss: 8.1154 - acc: 0.4875 - ETA: 5s - loss: 8.1148 - acc: 0.4877 - ETA: 5s - loss: 8.1197 - acc: 0.4872 - ETA: 5s - loss: 8.1085 - acc: 0.4880 - ETA: 5s - loss: 8.1079 - acc: 0.4881 - ETA: 5s - loss: 8.1022 - acc: 0.4886 - ETA: 4s - loss: 8.1067 - acc: 0.4884 - ETA: 4s - loss: 8.0912 - acc: 0.4895 - ETA: 4s - loss: 8.1006 - acc: 0.4890 - ETA: 4s - loss: 8.0904 - acc: 0.4898 - ETA: 4s - loss: 8.0910 - acc: 0.4896 - ETA: 4s - loss: 8.0908 - acc: 0.4897 - ETA: 4s - loss: 8.0951 - acc: 0.4895 - ETA: 4s - loss: 8.0994 - acc: 0.4894 - ETA: 4s - loss: 8.1081 - acc: 0.4889 - ETA: 4s - loss: 8.0985 - acc: 0.4896 - ETA: 4s - loss: 8.0801 - acc: 0.4908 - ETA: 4s - loss: 8.0844 - acc: 0.4907 - ETA: 4s - loss: 8.0929 - acc: 0.4902 - ETA: 4s - loss: 8.0839 - acc: 0.4909 - ETA: 4s - loss: 8.0757 - acc: 0.4912 - ETA: 4s - loss: 8.0586 - acc: 0.4924 - ETA: 4s - loss: 8.0460 - acc: 0.4932 - ETA: 3s - loss: 8.0390 - acc: 0.4936 - ETA: 3s - loss: 8.0597 - acc: 0.4923 - ETA: 3s - loss: 8.0622 - acc: 0.4919 - ETA: 3s - loss: 8.0582 - acc: 0.4923 - ETA: 3s - loss: 8.0649 - acc: 0.4913 - ETA: 3s - loss: 8.0885 - acc: 0.4900 - ETA: 3s - loss: 8.1117 - acc: 0.4886 - ETA: 3s - loss: 8.1035 - acc: 0.4892 - ETA: 3s - loss: 8.1107 - acc: 0.4888 - ETA: 3s - loss: 8.1103 - acc: 0.4889 - ETA: 3s - loss: 8.1247 - acc: 0.4881 - ETA: 3s - loss: 8.1353 - acc: 0.4875 - ETA: 3s - loss: 8.1291 - acc: 0.4872 - ETA: 3s - loss: 8.1275 - acc: 0.4873 - ETA: 3s - loss: 8.1222 - acc: 0.4876 - ETA: 3s - loss: 8.1295 - acc: 0.4871 - ETA: 3s - loss: 8.1396 - acc: 0.4865 - ETA: 3s - loss: 8.1287 - acc: 0.4871 - ETA: 2s - loss: 8.1421 - acc: 0.4863 - ETA: 2s - loss: 8.1277 - acc: 0.4873 - ETA: 2s - loss: 8.1387 - acc: 0.4863 - ETA: 2s - loss: 8.1458 - acc: 0.4858 - ETA: 2s - loss: 8.1383 - acc: 0.4863 - ETA: 2s - loss: 8.1243 - acc: 0.4873 - ETA: 2s - loss: 8.1105 - acc: 0.4882 - ETA: 2s - loss: 8.1133 - acc: 0.4881 - ETA: 2s - loss: 8.1425 - acc: 0.4864 - ETA: 2s - loss: 8.1386 - acc: 0.4867 - ETA: 2s - loss: 8.1374 - acc: 0.4866 - ETA: 2s - loss: 8.1432 - acc: 0.4863 - ETA: 2s - loss: 8.1494 - acc: 0.4858 - ETA: 2s - loss: 8.1298 - acc: 0.4871 - ETA: 2s - loss: 8.1418 - acc: 0.4864 - ETA: 2s - loss: 8.1380 - acc: 0.4863 - ETA: 2s - loss: 8.1528 - acc: 0.4855 - ETA: 1s - loss: 8.1463 - acc: 0.4858 - ETA: 1s - loss: 8.1365 - acc: 0.4865 - ETA: 1s - loss: 8.1456 - acc: 0.4858 - ETA: 1s - loss: 8.1333 - acc: 0.4865 - ETA: 1s - loss: 8.1420 - acc: 0.4858 - ETA: 1s - loss: 8.1237 - acc: 0.4869 - ETA: 1s - loss: 8.1146 - acc: 0.4875 - ETA: 1s - loss: 8.1234 - acc: 0.4868 - ETA: 1s - loss: 8.1143 - acc: 0.4875 - ETA: 1s - loss: 8.1053 - acc: 0.4881 - ETA: 1s - loss: 8.1079 - acc: 0.4880 - ETA: 1s - loss: 8.1219 - acc: 0.4870 - ETA: 1s - loss: 8.1271 - acc: 0.4868 - ETA: 1s - loss: 8.1381 - acc: 0.4861 - ETA: 1s - loss: 8.1357 - acc: 0.4860 - ETA: 1s - loss: 8.1270 - acc: 0.4866 - ETA: 1s - loss: 8.1298 - acc: 0.4864 - ETA: 1s - loss: 8.1105 - acc: 0.4875 - ETA: 1s - loss: 8.1051 - acc: 0.4878 - ETA: 0s - loss: 8.1129 - acc: 0.4873 - ETA: 0s - loss: 8.1072 - acc: 0.4877 - ETA: 0s - loss: 8.0937 - acc: 0.4887 - ETA: 0s - loss: 8.1014 - acc: 0.4882 - ETA: 0s - loss: 8.1037 - acc: 0.4881 - ETA: 0s - loss: 8.1009 - acc: 0.4884 - ETA: 0s - loss: 8.1032 - acc: 0.4883 - ETA: 0s - loss: 8.0884 - acc: 0.4892 - ETA: 0s - loss: 8.0755 - acc: 0.4900 - ETA: 0s - loss: 8.0795 - acc: 0.4898 - ETA: 0s - loss: 8.0819 - acc: 0.4897 - ETA: 0s - loss: 8.1043 - acc: 0.4884 - ETA: 0s - loss: 8.0941 - acc: 0.4890 - ETA: 0s - loss: 8.1013 - acc: 0.4887 - ETA: 0s - loss: 8.0988 - acc: 0.4887 - ETA: 0s - loss: 8.0955 - acc: 0.4888 - ETA: 0s - loss: 8.0953 - acc: 0.4889Epoch 00017: val_loss improved from 9.04338 to 8.95094, saving model to saved_models/weights.best.VGG16.hdf5
6680/6680 [==============================] - 10s - loss: 8.0903 - acc: 0.4892 - val_loss: 8.9509 - val_acc: 0.3701
Epoch 19/20
6640/6680 [============================>.] - ETA: 6s - loss: 9.2567 - acc: 0.4000 - ETA: 8s - loss: 9.0030 - acc: 0.4333 - ETA: 9s - loss: 8.4643 - acc: 0.4700 - ETA: 8s - loss: 8.6981 - acc: 0.4429 - ETA: 9s - loss: 8.6191 - acc: 0.4500 - ETA: 9s - loss: 8.2975 - acc: 0.4727 - ETA: 9s - loss: 8.4552 - acc: 0.4625 - ETA: 9s - loss: 8.6997 - acc: 0.4464 - ETA: 9s - loss: 8.5815 - acc: 0.4531 - ETA: 9s - loss: 8.4767 - acc: 0.4611 - ETA: 9s - loss: 8.3947 - acc: 0.4675 - ETA: 9s - loss: 8.4740 - acc: 0.4636 - ETA: 9s - loss: 8.4212 - acc: 0.4674 - ETA: 9s - loss: 8.4171 - acc: 0.4680 - ETA: 9s - loss: 8.4270 - acc: 0.4667 - ETA: 9s - loss: 8.5257 - acc: 0.4586 - ETA: 8s - loss: 8.3327 - acc: 0.4710 - ETA: 8s - loss: 8.2199 - acc: 0.4773 - ETA: 8s - loss: 8.3060 - acc: 0.4714 - ETA: 8s - loss: 8.1494 - acc: 0.4811 - ETA: 8s - loss: 8.1400 - acc: 0.4808 - ETA: 8s - loss: 8.0105 - acc: 0.4890 - ETA: 8s - loss: 8.1066 - acc: 0.4837 - ETA: 8s - loss: 8.1225 - acc: 0.4833 - ETA: 8s - loss: 8.0860 - acc: 0.4859 - ETA: 8s - loss: 8.1207 - acc: 0.4833 - ETA: 8s - loss: 8.0797 - acc: 0.4860 - ETA: 8s - loss: 8.0483 - acc: 0.4885 - ETA: 8s - loss: 8.0702 - acc: 0.4861 - ETA: 8s - loss: 8.1530 - acc: 0.4804 - ETA: 8s - loss: 8.2192 - acc: 0.4767 - ETA: 7s - loss: 8.2487 - acc: 0.4742 - ETA: 7s - loss: 8.1974 - acc: 0.4766 - ETA: 7s - loss: 8.1697 - acc: 0.4781 - ETA: 7s - loss: 8.1185 - acc: 0.4818 - ETA: 7s - loss: 8.1521 - acc: 0.4799 - ETA: 7s - loss: 8.1494 - acc: 0.4804 - ETA: 7s - loss: 8.1715 - acc: 0.4789 - ETA: 7s - loss: 8.1354 - acc: 0.4815 - ETA: 7s - loss: 8.1574 - acc: 0.4800 - ETA: 7s - loss: 8.1465 - acc: 0.4805 - ETA: 7s - loss: 8.1443 - acc: 0.4810 - ETA: 7s - loss: 8.1629 - acc: 0.4796 - ETA: 7s - loss: 8.1800 - acc: 0.4789 - ETA: 7s - loss: 8.1937 - acc: 0.4776 - ETA: 7s - loss: 8.1721 - acc: 0.4793 - ETA: 7s - loss: 8.1816 - acc: 0.4787 - ETA: 7s - loss: 8.1789 - acc: 0.4791 - ETA: 7s - loss: 8.1503 - acc: 0.4812 - ETA: 7s - loss: 8.1497 - acc: 0.4811 - ETA: 7s - loss: 8.0906 - acc: 0.4845 - ETA: 6s - loss: 8.0738 - acc: 0.4859 - ETA: 6s - loss: 8.0778 - acc: 0.4856 - ETA: 6s - loss: 8.0558 - acc: 0.4864 - ETA: 6s - loss: 8.0176 - acc: 0.4890 - ETA: 6s - loss: 8.0088 - acc: 0.4897 - ETA: 6s - loss: 8.0023 - acc: 0.4904 - ETA: 6s - loss: 8.0106 - acc: 0.4901 - ETA: 6s - loss: 7.9974 - acc: 0.4912 - ETA: 6s - loss: 7.9985 - acc: 0.4913 - ETA: 6s - loss: 7.9990 - acc: 0.4914 - ETA: 6s - loss: 8.0274 - acc: 0.4898 - ETA: 6s - loss: 8.0146 - acc: 0.4908 - ETA: 6s - loss: 7.9823 - acc: 0.4930 - ETA: 6s - loss: 7.9771 - acc: 0.4935 - ETA: 6s - loss: 8.0360 - acc: 0.4901 - ETA: 6s - loss: 8.0300 - acc: 0.4906 - ETA: 5s - loss: 8.0429 - acc: 0.4900 - ETA: 5s - loss: 8.0250 - acc: 0.4913 - ETA: 5s - loss: 8.0315 - acc: 0.4910 - ETA: 5s - loss: 7.9994 - acc: 0.4930 - ETA: 5s - loss: 8.0002 - acc: 0.4931 - ETA: 5s - loss: 8.0128 - acc: 0.4925 - ETA: 5s - loss: 8.0261 - acc: 0.4915 - ETA: 5s - loss: 8.0534 - acc: 0.4899 - ETA: 5s - loss: 8.0645 - acc: 0.4894 - ETA: 5s - loss: 8.0536 - acc: 0.4902 - ETA: 5s - loss: 8.0590 - acc: 0.4900 - ETA: 5s - loss: 8.0856 - acc: 0.4885 - ETA: 5s - loss: 8.0793 - acc: 0.4886 - ETA: 5s - loss: 8.0820 - acc: 0.4881 - ETA: 5s - loss: 8.0980 - acc: 0.4870 - ETA: 5s - loss: 8.1079 - acc: 0.4863 - ETA: 5s - loss: 8.1272 - acc: 0.4852 - ETA: 4s - loss: 8.1133 - acc: 0.4857 - ETA: 4s - loss: 8.0991 - acc: 0.4864 - ETA: 4s - loss: 8.1082 - acc: 0.4860 - ETA: 4s - loss: 8.1091 - acc: 0.4853 - ETA: 4s - loss: 8.1144 - acc: 0.4846 - ETA: 4s - loss: 8.1093 - acc: 0.4851 - ETA: 4s - loss: 8.1090 - acc: 0.4852 - ETA: 4s - loss: 8.1130 - acc: 0.4851 - ETA: 4s - loss: 8.0993 - acc: 0.4858 - ETA: 4s - loss: 8.1038 - acc: 0.4854 - ETA: 4s - loss: 8.1077 - acc: 0.4853 - ETA: 4s - loss: 8.0986 - acc: 0.4860 - ETA: 4s - loss: 8.1069 - acc: 0.4856 - ETA: 4s - loss: 8.1106 - acc: 0.4855 - ETA: 4s - loss: 8.1059 - acc: 0.4859 - ETA: 4s - loss: 8.1100 - acc: 0.4858 - ETA: 4s - loss: 8.1042 - acc: 0.4859 - ETA: 4s - loss: 8.1299 - acc: 0.4843 - ETA: 3s - loss: 8.1340 - acc: 0.4839 - ETA: 3s - loss: 8.1256 - acc: 0.4845 - ETA: 3s - loss: 8.1132 - acc: 0.4851 - ETA: 3s - loss: 8.1018 - acc: 0.4855 - ETA: 3s - loss: 8.0701 - acc: 0.4876 - ETA: 3s - loss: 8.0551 - acc: 0.4885 - ETA: 3s - loss: 8.0666 - acc: 0.4879 - ETA: 3s - loss: 8.0615 - acc: 0.4880 - ETA: 3s - loss: 8.0627 - acc: 0.4879 - ETA: 3s - loss: 8.0514 - acc: 0.4887 - ETA: 3s - loss: 8.0404 - acc: 0.4894 - ETA: 3s - loss: 8.0443 - acc: 0.4893 - ETA: 3s - loss: 8.0481 - acc: 0.4892 - ETA: 3s - loss: 8.0449 - acc: 0.4893 - ETA: 3s - loss: 8.0488 - acc: 0.4889 - ETA: 3s - loss: 8.0392 - acc: 0.4895 - ETA: 3s - loss: 8.0595 - acc: 0.4883 - ETA: 2s - loss: 8.0630 - acc: 0.4881 - ETA: 2s - loss: 8.0483 - acc: 0.4889 - ETA: 2s - loss: 8.0434 - acc: 0.4890 - ETA: 2s - loss: 8.0470 - acc: 0.4889 - ETA: 2s - loss: 8.0437 - acc: 0.4892 - ETA: 2s - loss: 8.0546 - acc: 0.4884 - ETA: 2s - loss: 8.0414 - acc: 0.4893 - ETA: 2s - loss: 8.0193 - acc: 0.4907 - ETA: 2s - loss: 8.0261 - acc: 0.4903 - ETA: 2s - loss: 8.0210 - acc: 0.4904 - ETA: 2s - loss: 8.0309 - acc: 0.4899 - ETA: 2s - loss: 8.0186 - acc: 0.4904 - ETA: 2s - loss: 8.0079 - acc: 0.4908 - ETA: 2s - loss: 8.0119 - acc: 0.4905 - ETA: 2s - loss: 8.0124 - acc: 0.4906 - ETA: 2s - loss: 8.0007 - acc: 0.4912 - ETA: 2s - loss: 8.0012 - acc: 0.4913 - ETA: 1s - loss: 7.9915 - acc: 0.4915 - ETA: 1s - loss: 8.0099 - acc: 0.4903 - ETA: 1s - loss: 8.0133 - acc: 0.4902 - ETA: 1s - loss: 8.0255 - acc: 0.4895 - ETA: 1s - loss: 8.0199 - acc: 0.4900 - ETA: 1s - loss: 8.0173 - acc: 0.4902 - ETA: 1s - loss: 8.0263 - acc: 0.4897 - ETA: 1s - loss: 8.0267 - acc: 0.4896 - ETA: 1s - loss: 8.0042 - acc: 0.4910 - ETA: 1s - loss: 8.0053 - acc: 0.4908 - ETA: 1s - loss: 8.0008 - acc: 0.4911 - ETA: 1s - loss: 7.9992 - acc: 0.4911 - ETA: 1s - loss: 7.9996 - acc: 0.4912 - ETA: 1s - loss: 7.9995 - acc: 0.4911 - ETA: 1s - loss: 7.9999 - acc: 0.4912 - ETA: 1s - loss: 8.0058 - acc: 0.4909 - ETA: 1s - loss: 8.0143 - acc: 0.4904 - ETA: 0s - loss: 8.0174 - acc: 0.4902 - ETA: 0s - loss: 7.9964 - acc: 0.4916 - ETA: 0s - loss: 8.0021 - acc: 0.4913 - ETA: 0s - loss: 8.0174 - acc: 0.4904 - ETA: 0s - loss: 8.0124 - acc: 0.4907 - ETA: 0s - loss: 8.0102 - acc: 0.4910 - ETA: 0s - loss: 8.0054 - acc: 0.4913 - ETA: 0s - loss: 8.0085 - acc: 0.4911 - ETA: 0s - loss: 8.0064 - acc: 0.4913 - ETA: 0s - loss: 8.0223 - acc: 0.4903 - ETA: 0s - loss: 8.0080 - acc: 0.4911 - ETA: 0s - loss: 8.0233 - acc: 0.4902 - ETA: 0s - loss: 8.0186 - acc: 0.4906 - ETA: 0s - loss: 8.0218 - acc: 0.4903 - ETA: 0s - loss: 8.0171 - acc: 0.4907 - ETA: 0s - loss: 8.0160 - acc: 0.4908 - ETA: 0s - loss: 8.0261 - acc: 0.4901Epoch 00018: val_loss improved from 8.95094 to 8.87007, saving model to saved_models/weights.best.VGG16.hdf5
6680/6680 [==============================] - 10s - loss: 8.0218 - acc: 0.4901 - val_loss: 8.8701 - val_acc: 0.3677
Epoch 20/20
6640/6680 [============================>.] - ETA: 6s - loss: 5.9277 - acc: 0.5500 - ETA: 7s - loss: 7.6661 - acc: 0.4625 - ETA: 8s - loss: 8.4698 - acc: 0.4333 - ETA: 8s - loss: 8.5332 - acc: 0.4375 - ETA: 8s - loss: 8.3215 - acc: 0.4500 - ETA: 8s - loss: 8.8151 - acc: 0.4250 - ETA: 8s - loss: 8.6515 - acc: 0.4393 - ETA: 8s - loss: 8.4197 - acc: 0.4563 - ETA: 8s - loss: 8.4291 - acc: 0.4556 - ETA: 8s - loss: 8.5136 - acc: 0.4525 - ETA: 8s - loss: 8.4723 - acc: 0.4568 - ETA: 8s - loss: 8.3707 - acc: 0.4646 - ETA: 8s - loss: 8.2549 - acc: 0.4731 - ETA: 8s - loss: 8.2409 - acc: 0.4750 - ETA: 8s - loss: 8.1572 - acc: 0.4800 - ETA: 8s - loss: 8.1008 - acc: 0.4844 - ETA: 8s - loss: 8.1221 - acc: 0.4838 - ETA: 8s - loss: 8.1651 - acc: 0.4806 - ETA: 8s - loss: 8.1647 - acc: 0.4789 - ETA: 8s - loss: 8.0788 - acc: 0.4850 - ETA: 8s - loss: 8.0802 - acc: 0.4841 - ETA: 8s - loss: 8.1422 - acc: 0.4802 - ETA: 8s - loss: 8.1076 - acc: 0.4811 - ETA: 8s - loss: 8.0885 - acc: 0.4830 - ETA: 8s - loss: 8.0544 - acc: 0.4857 - ETA: 8s - loss: 8.0704 - acc: 0.4853 - ETA: 8s - loss: 8.0705 - acc: 0.4858 - ETA: 7s - loss: 8.0554 - acc: 0.4873 - ETA: 7s - loss: 8.0980 - acc: 0.4851 - ETA: 7s - loss: 8.0831 - acc: 0.4864 - ETA: 7s - loss: 8.0699 - acc: 0.4869 - ETA: 7s - loss: 8.0696 - acc: 0.4873 - ETA: 7s - loss: 8.0073 - acc: 0.4915 - ETA: 7s - loss: 8.0035 - acc: 0.4918 - ETA: 7s - loss: 8.0402 - acc: 0.4899 - ETA: 7s - loss: 7.9974 - acc: 0.4923 - ETA: 7s - loss: 7.9910 - acc: 0.4918 - ETA: 7s - loss: 8.0251 - acc: 0.4900 - ETA: 7s - loss: 8.0496 - acc: 0.4883 - ETA: 7s - loss: 8.0294 - acc: 0.4899 - ETA: 7s - loss: 8.0204 - acc: 0.4907 - ETA: 7s - loss: 8.0198 - acc: 0.4910 - ETA: 7s - loss: 7.9923 - acc: 0.4929 - ETA: 7s - loss: 7.9877 - acc: 0.4931 - ETA: 7s - loss: 7.9729 - acc: 0.4938 - ETA: 6s - loss: 7.9305 - acc: 0.4967 - ETA: 6s - loss: 7.9199 - acc: 0.4968 - ETA: 6s - loss: 7.9647 - acc: 0.4943 - ETA: 6s - loss: 7.9348 - acc: 0.4959 - ETA: 6s - loss: 7.9616 - acc: 0.4945 - ETA: 6s - loss: 7.9398 - acc: 0.4961 - ETA: 6s - loss: 7.9539 - acc: 0.4947 - ETA: 6s - loss: 7.9559 - acc: 0.4948 - ETA: 6s - loss: 7.9728 - acc: 0.4940 - ETA: 6s - loss: 7.9817 - acc: 0.4936 - ETA: 6s - loss: 7.9975 - acc: 0.4929 - ETA: 6s - loss: 8.0195 - acc: 0.4916 - ETA: 6s - loss: 8.0211 - acc: 0.4912 - ETA: 6s - loss: 8.0920 - acc: 0.4866 - ETA: 6s - loss: 8.0756 - acc: 0.4877 - ETA: 6s - loss: 8.0505 - acc: 0.4892 - ETA: 6s - loss: 8.0507 - acc: 0.4893 - ETA: 6s - loss: 8.0388 - acc: 0.4899 - ETA: 5s - loss: 8.0394 - acc: 0.4901 - ETA: 5s - loss: 8.0410 - acc: 0.4898 - ETA: 5s - loss: 8.0476 - acc: 0.4896 - ETA: 5s - loss: 8.0419 - acc: 0.4898 - ETA: 5s - loss: 8.0427 - acc: 0.4896 - ETA: 5s - loss: 8.0249 - acc: 0.4907 - ETA: 5s - loss: 8.0216 - acc: 0.4909 - ETA: 5s - loss: 8.0366 - acc: 0.4899 - ETA: 5s - loss: 8.0038 - acc: 0.4918 - ETA: 5s - loss: 7.9937 - acc: 0.4923 - ETA: 5s - loss: 8.0281 - acc: 0.4903 - ETA: 5s - loss: 8.0086 - acc: 0.4915 - ETA: 5s - loss: 8.0201 - acc: 0.4909 - ETA: 5s - loss: 7.9993 - acc: 0.4924 - ETA: 5s - loss: 7.9744 - acc: 0.4935 - ETA: 5s - loss: 7.9807 - acc: 0.4932 - ETA: 5s - loss: 7.9779 - acc: 0.4930 - ETA: 5s - loss: 7.9536 - acc: 0.4947 - ETA: 4s - loss: 7.9600 - acc: 0.4944 - ETA: 4s - loss: 7.9877 - acc: 0.4926 - ETA: 4s - loss: 7.9750 - acc: 0.4933 - ETA: 4s - loss: 7.9761 - acc: 0.4934 - ETA: 4s - loss: 7.9867 - acc: 0.4929 - ETA: 4s - loss: 8.0111 - acc: 0.4915 - ETA: 4s - loss: 7.9710 - acc: 0.4939 - ETA: 4s - loss: 7.9582 - acc: 0.4949 - ETA: 4s - loss: 7.9384 - acc: 0.4960 - ETA: 4s - loss: 7.9280 - acc: 0.4966 - ETA: 4s - loss: 7.9349 - acc: 0.4961 - ETA: 4s - loss: 7.9347 - acc: 0.4962 - ETA: 4s - loss: 7.9230 - acc: 0.4970 - ETA: 4s - loss: 7.9133 - acc: 0.4976 - ETA: 4s - loss: 7.9149 - acc: 0.4976 - ETA: 4s - loss: 7.9164 - acc: 0.4976 - ETA: 4s - loss: 7.9122 - acc: 0.4977 - ETA: 4s - loss: 7.9040 - acc: 0.4979 - ETA: 3s - loss: 7.8985 - acc: 0.4980 - ETA: 3s - loss: 7.8926 - acc: 0.4982 - ETA: 3s - loss: 7.8952 - acc: 0.4980 - ETA: 3s - loss: 7.8928 - acc: 0.4983 - ETA: 3s - loss: 7.8754 - acc: 0.4993 - ETA: 3s - loss: 7.8967 - acc: 0.4981 - ETA: 3s - loss: 7.8873 - acc: 0.4986 - ETA: 3s - loss: 7.9129 - acc: 0.4969 - ETA: 3s - loss: 7.9148 - acc: 0.4965 - ETA: 3s - loss: 7.8937 - acc: 0.4979 - ETA: 3s - loss: 7.9032 - acc: 0.4970 - ETA: 3s - loss: 7.8973 - acc: 0.4975 - ETA: 3s - loss: 7.8978 - acc: 0.4971 - ETA: 3s - loss: 7.9065 - acc: 0.4966 - ETA: 3s - loss: 7.9115 - acc: 0.4964 - ETA: 3s - loss: 7.9080 - acc: 0.4965 - ETA: 3s - loss: 7.9164 - acc: 0.4961 - ETA: 2s - loss: 7.9159 - acc: 0.4959 - ETA: 2s - loss: 7.9038 - acc: 0.4966 - ETA: 2s - loss: 7.8917 - acc: 0.4972 - ETA: 2s - loss: 7.8905 - acc: 0.4970 - ETA: 2s - loss: 7.8948 - acc: 0.4967 - ETA: 2s - loss: 7.9040 - acc: 0.4959 - ETA: 2s - loss: 7.9255 - acc: 0.4944 - ETA: 2s - loss: 7.9236 - acc: 0.4945 - ETA: 2s - loss: 7.9256 - acc: 0.4943 - ETA: 2s - loss: 7.9217 - acc: 0.4942 - ETA: 2s - loss: 7.9246 - acc: 0.4938 - ETA: 2s - loss: 7.9154 - acc: 0.4943 - ETA: 2s - loss: 7.9122 - acc: 0.4943 - ETA: 2s - loss: 7.9165 - acc: 0.4942 - ETA: 2s - loss: 7.9253 - acc: 0.4936 - ETA: 2s - loss: 7.9310 - acc: 0.4929 - ETA: 2s - loss: 7.9170 - acc: 0.4937 - ETA: 1s - loss: 7.9120 - acc: 0.4942 - ETA: 1s - loss: 7.9125 - acc: 0.4940 - ETA: 1s - loss: 7.9046 - acc: 0.4946 - ETA: 1s - loss: 7.9036 - acc: 0.4943 - ETA: 1s - loss: 7.9065 - acc: 0.4940 - ETA: 1s - loss: 7.8842 - acc: 0.4955 - ETA: 1s - loss: 7.8740 - acc: 0.4960 - ETA: 1s - loss: 7.8798 - acc: 0.4957 - ETA: 1s - loss: 7.8696 - acc: 0.4964 - ETA: 1s - loss: 7.8574 - acc: 0.4970 - ETA: 1s - loss: 7.8608 - acc: 0.4968 - ETA: 1s - loss: 7.8594 - acc: 0.4970 - ETA: 1s - loss: 7.8553 - acc: 0.4974 - ETA: 1s - loss: 7.8548 - acc: 0.4973 - ETA: 1s - loss: 7.8562 - acc: 0.4973 - ETA: 1s - loss: 7.8571 - acc: 0.4971 - ETA: 1s - loss: 7.8561 - acc: 0.4971 - ETA: 1s - loss: 7.8628 - acc: 0.4966 - ETA: 0s - loss: 7.8645 - acc: 0.4965 - ETA: 0s - loss: 7.8684 - acc: 0.4964 - ETA: 0s - loss: 7.8627 - acc: 0.4964 - ETA: 0s - loss: 7.8746 - acc: 0.4958 - ETA: 0s - loss: 7.8811 - acc: 0.4955 - ETA: 0s - loss: 7.8775 - acc: 0.4955 - ETA: 0s - loss: 7.8813 - acc: 0.4954 - ETA: 0s - loss: 7.8836 - acc: 0.4952 - ETA: 0s - loss: 7.8858 - acc: 0.4948 - ETA: 0s - loss: 7.8770 - acc: 0.4953 - ETA: 0s - loss: 7.8884 - acc: 0.4945 - ETA: 0s - loss: 7.8799 - acc: 0.4950 - ETA: 0s - loss: 7.8741 - acc: 0.4952 - ETA: 0s - loss: 7.8926 - acc: 0.4942 - ETA: 0s - loss: 7.8893 - acc: 0.4944 - ETA: 0s - loss: 7.8830 - acc: 0.4948 - ETA: 0s - loss: 7.8720 - acc: 0.4956Epoch 00019: val_loss improved from 8.87007 to 8.69436, saving model to saved_models/weights.best.VGG16.hdf5
6680/6680 [==============================] - 10s - loss: 7.8707 - acc: 0.4958 - val_loss: 8.6944 - val_acc: 0.3868
Out[50]:
<keras.callbacks.History at 0x1abec6df6a0>

Load the Model with the Best Validation Loss

In [51]:
VGG16_model.load_weights('saved_models/weights.best.VGG16.hdf5')

Test the Model

Now, we can use the CNN to test how well it identifies breed within our test dataset of dog images. We print the test accuracy below.

In [54]:
# get index of predicted dog breed for each image in test set
VGG16_predictions = [np.argmax(VGG16_model.predict(np.expand_dims(feature, axis=0))) for feature in test_VGG16]

# report test accuracy
test_accuracy = 100*np.sum(np.array(VGG16_predictions)==np.argmax(test_targets, axis=1))/len(VGG16_predictions)
print('Test accuracy: %.4f%%' % test_accuracy)

Test accuracy: 41.9856%

Predict Dog Breed with the Model

In [55]:
from extract_bottleneck_features import *

def VGG16_predict_breed(img_path):
    # extract bottleneck features
    bottleneck_feature = extract_VGG16(path_to_tensor(img_path))
    # obtain predicted vector
    predicted_vector = VGG16_model.predict(bottleneck_feature)
    # return dog breed that is predicted by the model
    return dog_names[np.argmax(predicted_vector)]

Step 5: Create a CNN to Classify Dog Breeds (using Transfer Learning)

You will now use transfer learning to create a CNN that can identify dog breed from images. Your CNN must attain at least 60% accuracy on the test set.

In Step 4, we used transfer learning to create a CNN using VGG-16 bottleneck features. In this section, you must use the bottleneck features from a different pre-trained model. To make things easier for you, we have pre-computed the features for all of the networks that are currently available in Keras:

The files are encoded as such:

Dog{network}Data.npz

where {network}, in the above filename, can be one of VGG19, Resnet50, InceptionV3, or Xception. Pick one of the above architectures, download the corresponding bottleneck features, and store the downloaded file in the bottleneck_features/ folder in the repository.

(IMPLEMENTATION) Obtain Bottleneck Features

In the code block below, extract the bottleneck features corresponding to the train, test, and validation sets by running the following:

bottleneck_features = np.load('bottleneck_features/Dog{network}Data.npz')
train_{network} = bottleneck_features['train']
valid_{network} = bottleneck_features['valid']
test_{network} = bottleneck_features['test']
In [57]:
### TODO: Obtain bottleneck features from another pre-trained CNN.
bottleneck_features = np.load('bottleneck_features/DogResnet50Data.npz')
train_Resnet50 = bottleneck_features['train']
valid_Resnet50 = bottleneck_features['valid']
test_Resnet50 = bottleneck_features['test']

(IMPLEMENTATION) Model Architecture

Create a CNN to classify dog breed. At the end of your code cell block, summarize the layers of your model by executing the line:

    <your model's name>.summary()

Question 5: Outline the steps you took to get to your final CNN architecture and your reasoning at each step. Describe why you think the architecture is suitable for the current problem.

Answer: i chose the Resnet50 model. The model solves the vanishing gradient problem and has an outstanding performance. The first layer is a pooling layer followed by a dense layer with a softmax activitation. This classifies the output into 133 categories. The architecture lead to a accurace of 82%. By training the model in 20 epochs and picked the model with the best validation loss.

In [60]:
### 
my_model = Sequential()
my_model.add(GlobalAveragePooling2D(input_shape = train_Resnet50.shape[1:]))
my_model.add(Dense(133, activation = 'softmax'))
my_model.summary()

_________________________________________________________________
Layer (type)                 Output Shape              Param #   
=================================================================
global_average_pooling2d_14  (None, 2048)              0         
_________________________________________________________________
dense_16 (Dense)             (None, 133)               272517    
=================================================================
Total params: 272,517.0
Trainable params: 272,517.0
Non-trainable params: 0.0
_________________________________________________________________

(IMPLEMENTATION) Compile the Model

In [62]:
### TODO: Compile the model.
my_model.compile(loss='categorical_crossentropy', optimizer = 'rmsprop', metrics = ['accuracy'])

(IMPLEMENTATION) Train the Model

Train your model in the code cell below. Use model checkpointing to save the model that attains the best validation loss.

You are welcome to augment the training data, but this is not a requirement.

In [66]:
### TODO: Train the model.
checkpointer = ModelCheckpoint(filepath='saved_models/weights.best.ResNet50.hdf5', 
                               verbose=1, save_best_only=True)

my_model.fit(train_Resnet50, train_targets, 
          validation_data=(valid_Resnet50, valid_targets),
          epochs=20, batch_size=20, callbacks=[checkpointer], verbose=1)

Train on 6680 samples, validate on 835 samples
Epoch 1/20
6660/6680 [============================>.] - ETA: 1988s - loss: 5.7151 - acc: 0.0000e+00 - ETA: 1054s - loss: 5.8764 - acc: 0.0500     - ETA: 743s - loss: 5.9654 - acc: 0.0333  - ETA: 568s - loss: 5.9333 - acc: 0.0500 - ETA: 469s - loss: 5.8155 - acc: 0.0500 - ETA: 400s - loss: 5.8517 - acc: 0.0417 - ETA: 350s - loss: 5.7237 - acc: 0.0500 - ETA: 317s - loss: 5.7707 - acc: 0.0438 - ETA: 286s - loss: 5.6846 - acc: 0.0500 - ETA: 262s - loss: 5.6828 - acc: 0.0450 - ETA: 244s - loss: 5.6883 - acc: 0.0455 - ETA: 226s - loss: 5.5850 - acc: 0.0500 - ETA: 210s - loss: 5.4838 - acc: 0.0577 - ETA: 198s - loss: 5.4126 - acc: 0.0571 - ETA: 188s - loss: 5.4146 - acc: 0.0567 - ETA: 178s - loss: 5.3114 - acc: 0.0719 - ETA: 169s - loss: 5.2441 - acc: 0.0735 - ETA: 161s - loss: 5.2002 - acc: 0.0722 - ETA: 157s - loss: 5.1746 - acc: 0.0816 - ETA: 151s - loss: 5.1179 - acc: 0.0875 - ETA: 144s - loss: 5.0711 - acc: 0.0976 - ETA: 139s - loss: 5.0459 - acc: 0.1000 - ETA: 133s - loss: 5.0304 - acc: 0.1043 - ETA: 129s - loss: 4.9747 - acc: 0.1125 - ETA: 124s - loss: 4.9384 - acc: 0.1200 - ETA: 120s - loss: 4.8856 - acc: 0.1231 - ETA: 116s - loss: 4.8426 - acc: 0.1296 - ETA: 112s - loss: 4.7964 - acc: 0.1321 - ETA: 109s - loss: 4.7615 - acc: 0.1328 - ETA: 106s - loss: 4.7321 - acc: 0.1333 - ETA: 103s - loss: 4.6847 - acc: 0.1371 - ETA: 101s - loss: 4.6336 - acc: 0.1438 - ETA: 98s - loss: 4.5921 - acc: 0.1455  - ETA: 96s - loss: 4.5515 - acc: 0.1471 - ETA: 94s - loss: 4.5087 - acc: 0.1514 - ETA: 91s - loss: 4.4480 - acc: 0.1611 - ETA: 89s - loss: 4.4054 - acc: 0.1622 - ETA: 87s - loss: 4.3718 - acc: 0.1671 - ETA: 85s - loss: 4.3308 - acc: 0.1692 - ETA: 83s - loss: 4.3041 - acc: 0.1738 - ETA: 82s - loss: 4.2586 - acc: 0.1829 - ETA: 80s - loss: 4.2368 - acc: 0.1833 - ETA: 79s - loss: 4.2025 - acc: 0.1849 - ETA: 77s - loss: 4.1806 - acc: 0.1852 - ETA: 75s - loss: 4.1536 - acc: 0.1878 - ETA: 74s - loss: 4.1201 - acc: 0.1935 - ETA: 72s - loss: 4.0951 - acc: 0.1989 - ETA: 71s - loss: 4.0625 - acc: 0.2010 - ETA: 70s - loss: 4.0290 - acc: 0.2031 - ETA: 69s - loss: 4.0101 - acc: 0.2050 - ETA: 68s - loss: 3.9718 - acc: 0.2098 - ETA: 66s - loss: 3.9320 - acc: 0.2173 - ETA: 65s - loss: 3.9067 - acc: 0.2208 - ETA: 64s - loss: 3.8736 - acc: 0.2296 - ETA: 63s - loss: 3.8511 - acc: 0.2345 - ETA: 63s - loss: 3.8256 - acc: 0.2375 - ETA: 61s - loss: 3.7945 - acc: 0.2439 - ETA: 61s - loss: 3.7630 - acc: 0.2474 - ETA: 60s - loss: 3.7410 - acc: 0.2500 - ETA: 59s - loss: 3.7138 - acc: 0.2550 - ETA: 58s - loss: 3.6854 - acc: 0.2574 - ETA: 57s - loss: 3.6488 - acc: 0.2645 - ETA: 56s - loss: 3.6203 - acc: 0.2690 - ETA: 55s - loss: 3.5956 - acc: 0.2742 - ETA: 55s - loss: 3.5726 - acc: 0.2785 - ETA: 54s - loss: 3.5577 - acc: 0.2788 - ETA: 53s - loss: 3.5309 - acc: 0.2836 - ETA: 53s - loss: 3.5150 - acc: 0.2853 - ETA: 52s - loss: 3.4910 - acc: 0.2884 - ETA: 51s - loss: 3.4773 - acc: 0.2886 - ETA: 51s - loss: 3.4540 - acc: 0.2901 - ETA: 50s - loss: 3.4284 - acc: 0.2944 - ETA: 50s - loss: 3.4057 - acc: 0.2966 - ETA: 49s - loss: 3.3932 - acc: 0.2986 - ETA: 47s - loss: 3.3551 - acc: 0.3020 - ETA: 47s - loss: 3.3426 - acc: 0.3026 - ETA: 46s - loss: 3.3250 - acc: 0.3058 - ETA: 46s - loss: 3.3064 - acc: 0.3089 - ETA: 45s - loss: 3.2873 - acc: 0.3106 - ETA: 45s - loss: 3.2773 - acc: 0.3105 - ETA: 43s - loss: 3.2419 - acc: 0.3181 - ETA: 43s - loss: 3.2206 - acc: 0.3220 - ETA: 42s - loss: 3.2000 - acc: 0.3259 - ETA: 42s - loss: 3.1823 - acc: 0.3267 - ETA: 41s - loss: 3.1484 - acc: 0.3313 - ETA: 40s - loss: 3.1340 - acc: 0.3326 - ETA: 40s - loss: 3.1248 - acc: 0.3339 - ETA: 39s - loss: 3.1075 - acc: 0.3374 - ETA: 39s - loss: 3.0943 - acc: 0.3391 - ETA: 39s - loss: 3.0743 - acc: 0.3425 - ETA: 38s - loss: 3.0614 - acc: 0.3441 - ETA: 38s - loss: 3.0535 - acc: 0.3453 - ETA: 37s - loss: 3.0367 - acc: 0.3490 - ETA: 37s - loss: 3.0111 - acc: 0.3531 - ETA: 36s - loss: 2.9963 - acc: 0.3561 - ETA: 36s - loss: 2.9835 - acc: 0.3585 - ETA: 35s - loss: 2.9708 - acc: 0.3609 - ETA: 35s - loss: 2.9592 - acc: 0.3632 - ETA: 35s - loss: 2.9442 - acc: 0.3655 - ETA: 34s - loss: 2.9273 - acc: 0.3688 - ETA: 34s - loss: 2.9118 - acc: 0.3724 - ETA: 34s - loss: 2.8963 - acc: 0.3764 - ETA: 33s - loss: 2.8898 - acc: 0.3762 - ETA: 33s - loss: 2.8795 - acc: 0.3773 - ETA: 33s - loss: 2.8649 - acc: 0.3798 - ETA: 32s - loss: 2.8319 - acc: 0.3865 - ETA: 32s - loss: 2.8183 - acc: 0.3884 - ETA: 31s - loss: 2.7972 - acc: 0.3917 - ETA: 31s - loss: 2.7857 - acc: 0.3930 - ETA: 30s - loss: 2.7707 - acc: 0.3948 - ETA: 30s - loss: 2.7592 - acc: 0.3962 - ETA: 30s - loss: 2.7462 - acc: 0.3987 - ETA: 29s - loss: 2.7342 - acc: 0.4013 - ETA: 29s - loss: 2.7208 - acc: 0.4038 - ETA: 28s - loss: 2.6943 - acc: 0.4078 - ETA: 28s - loss: 2.6825 - acc: 0.4098 - ETA: 28s - loss: 2.6734 - acc: 0.4109 - ETA: 27s - loss: 2.6533 - acc: 0.4151 - ETA: 27s - loss: 2.6441 - acc: 0.4161 - ETA: 27s - loss: 2.6234 - acc: 0.4194 - ETA: 26s - loss: 2.6130 - acc: 0.4219 - ETA: 26s - loss: 2.5908 - acc: 0.4250 - ETA: 26s - loss: 2.5813 - acc: 0.4263 - ETA: 25s - loss: 2.5713 - acc: 0.4284 - ETA: 25s - loss: 2.5663 - acc: 0.4293 - ETA: 25s - loss: 2.5572 - acc: 0.4313 - ETA: 25s - loss: 2.5456 - acc: 0.4336 - ETA: 24s - loss: 2.5341 - acc: 0.4359 - ETA: 24s - loss: 2.5236 - acc: 0.4381 - ETA: 24s - loss: 2.5148 - acc: 0.4393 - ETA: 23s - loss: 2.4951 - acc: 0.4423 - ETA: 23s - loss: 2.4770 - acc: 0.4451 - ETA: 22s - loss: 2.4569 - acc: 0.4486 - ETA: 22s - loss: 2.4471 - acc: 0.4500 - ETA: 22s - loss: 2.4376 - acc: 0.4520 - ETA: 22s - loss: 2.4229 - acc: 0.4537 - ETA: 21s - loss: 2.4052 - acc: 0.4572 - ETA: 21s - loss: 2.3970 - acc: 0.4592 - ETA: 21s - loss: 2.3911 - acc: 0.4604 - ETA: 21s - loss: 2.3817 - acc: 0.4616 - ETA: 20s - loss: 2.3760 - acc: 0.4625 - ETA: 20s - loss: 2.3571 - acc: 0.4655 - ETA: 20s - loss: 2.3479 - acc: 0.4676 - ETA: 20s - loss: 2.3421 - acc: 0.4684 - ETA: 19s - loss: 2.3344 - acc: 0.4702 - ETA: 19s - loss: 2.3187 - acc: 0.4721 - ETA: 19s - loss: 2.3140 - acc: 0.4726 - ETA: 19s - loss: 2.3058 - acc: 0.4733 - ETA: 18s - loss: 2.2906 - acc: 0.4763 - ETA: 18s - loss: 2.2828 - acc: 0.4783 - ETA: 18s - loss: 2.2681 - acc: 0.4809 - ETA: 17s - loss: 2.2571 - acc: 0.4826 - ETA: 17s - loss: 2.2437 - acc: 0.4845 - ETA: 17s - loss: 2.2357 - acc: 0.4863 - ETA: 16s - loss: 2.2248 - acc: 0.4881 - ETA: 16s - loss: 2.2113 - acc: 0.4905 - ETA: 16s - loss: 2.2026 - acc: 0.4920 - ETA: 16s - loss: 2.1942 - acc: 0.4934 - ETA: 15s - loss: 2.1916 - acc: 0.4934 - ETA: 15s - loss: 2.1784 - acc: 0.4951 - ETA: 15s - loss: 2.1746 - acc: 0.4960 - ETA: 15s - loss: 2.1686 - acc: 0.4971 - ETA: 15s - loss: 2.1636 - acc: 0.4981 - ETA: 15s - loss: 2.1578 - acc: 0.4989 - ETA: 14s - loss: 2.1537 - acc: 0.4995 - ETA: 14s - loss: 2.1511 - acc: 0.4997 - ETA: 14s - loss: 2.1378 - acc: 0.5028 - ETA: 14s - loss: 2.1313 - acc: 0.5044 - ETA: 14s - loss: 2.1187 - acc: 0.5071 - ETA: 13s - loss: 2.1097 - acc: 0.5083 - ETA: 13s - loss: 2.1031 - acc: 0.5101 - ETA: 13s - loss: 2.0890 - acc: 0.5129 - ETA: 13s - loss: 2.0825 - acc: 0.5139 - ETA: 12s - loss: 2.0739 - acc: 0.5154 - ETA: 12s - loss: 2.0666 - acc: 0.5163 - ETA: 12s - loss: 2.0581 - acc: 0.5173 - ETA: 12s - loss: 2.0496 - acc: 0.5188 - ETA: 11s - loss: 2.0378 - acc: 0.5208 - ETA: 11s - loss: 2.0307 - acc: 0.5218 - ETA: 11s - loss: 2.0249 - acc: 0.5229 - ETA: 11s - loss: 2.0146 - acc: 0.5248 - ETA: 11s - loss: 2.0131 - acc: 0.5251 - ETA: 11s - loss: 2.0116 - acc: 0.5255 - ETA: 10s - loss: 2.0053 - acc: 0.5265 - ETA: 10s - loss: 1.9977 - acc: 0.5284 - ETA: 10s - loss: 1.9928 - acc: 0.5294 - ETA: 10s - loss: 1.9873 - acc: 0.5303 - ETA: 10s - loss: 1.9844 - acc: 0.5306 - ETA: 10s - loss: 1.9831 - acc: 0.5309 - ETA: 10s - loss: 1.9781 - acc: 0.5312 - ETA: 9s - loss: 1.9714 - acc: 0.5327  - ETA: 9s - loss: 1.9599 - acc: 0.5352 - ETA: 9s - loss: 1.9509 - acc: 0.5375 - ETA: 9s - loss: 1.9479 - acc: 0.5378 - ETA: 9s - loss: 1.9435 - acc: 0.5382 - ETA: 8s - loss: 1.9329 - acc: 0.5405 - ETA: 8s - loss: 1.9282 - acc: 0.5416 - ETA: 8s - loss: 1.9253 - acc: 0.5422 - ETA: 8s - loss: 1.9174 - acc: 0.5435 - ETA: 8s - loss: 1.9072 - acc: 0.5459 - ETA: 8s - loss: 1.8991 - acc: 0.5465 - ETA: 7s - loss: 1.8921 - acc: 0.5480 - ETA: 7s - loss: 1.8845 - acc: 0.5488 - ETA: 7s - loss: 1.8759 - acc: 0.5504 - ETA: 7s - loss: 1.8751 - acc: 0.5510 - ETA: 7s - loss: 1.8708 - acc: 0.5520 - ETA: 7s - loss: 1.8645 - acc: 0.5522 - ETA: 6s - loss: 1.8620 - acc: 0.5525 - ETA: 6s - loss: 1.8547 - acc: 0.5537 - ETA: 6s - loss: 1.8477 - acc: 0.5546 - ETA: 6s - loss: 1.8401 - acc: 0.5559 - ETA: 6s - loss: 1.8362 - acc: 0.5565 - ETA: 5s - loss: 1.8308 - acc: 0.5576 - ETA: 5s - loss: 1.8269 - acc: 0.5581 - ETA: 5s - loss: 1.8191 - acc: 0.5596 - ETA: 5s - loss: 1.8132 - acc: 0.5608 - ETA: 5s - loss: 1.8064 - acc: 0.5624 - ETA: 5s - loss: 1.8036 - acc: 0.5629 - ETA: 5s - loss: 1.7998 - acc: 0.5632 - ETA: 4s - loss: 1.7927 - acc: 0.5645 - ETA: 4s - loss: 1.7891 - acc: 0.5655 - ETA: 4s - loss: 1.7821 - acc: 0.5661 - ETA: 4s - loss: 1.7803 - acc: 0.5664 - ETA: 4s - loss: 1.7764 - acc: 0.5673 - ETA: 4s - loss: 1.7668 - acc: 0.5696 - ETA: 4s - loss: 1.7606 - acc: 0.5707 - ETA: 3s - loss: 1.7518 - acc: 0.5723 - ETA: 3s - loss: 1.7486 - acc: 0.5726 - ETA: 3s - loss: 1.7460 - acc: 0.5732 - ETA: 3s - loss: 1.7411 - acc: 0.5744 - ETA: 3s - loss: 1.7383 - acc: 0.5748 - ETA: 3s - loss: 1.7360 - acc: 0.5751 - ETA: 3s - loss: 1.7325 - acc: 0.5754 - ETA: 3s - loss: 1.7307 - acc: 0.5753 - ETA: 2s - loss: 1.7232 - acc: 0.5772 - ETA: 2s - loss: 1.7201 - acc: 0.5774 - ETA: 2s - loss: 1.7180 - acc: 0.5778 - ETA: 2s - loss: 1.7126 - acc: 0.5785 - ETA: 2s - loss: 1.7048 - acc: 0.5804 - ETA: 2s - loss: 1.7019 - acc: 0.5810 - ETA: 2s - loss: 1.6984 - acc: 0.5815 - ETA: 2s - loss: 1.6950 - acc: 0.5825 - ETA: 1s - loss: 1.6894 - acc: 0.5834 - ETA: 1s - loss: 1.6831 - acc: 0.5848 - ETA: 1s - loss: 1.6791 - acc: 0.5858 - ETA: 1s - loss: 1.6727 - acc: 0.5870 - ETA: 1s - loss: 1.6684 - acc: 0.5875 - ETA: 1s - loss: 1.6661 - acc: 0.5879 - ETA: 1s - loss: 1.6633 - acc: 0.5882 - ETA: 1s - loss: 1.6574 - acc: 0.5894 - ETA: 0s - loss: 1.6514 - acc: 0.5909 - ETA: 0s - loss: 1.6456 - acc: 0.5925 - ETA: 0s - loss: 1.6400 - acc: 0.5936 - ETA: 0s - loss: 1.6372 - acc: 0.5942 - ETA: 0s - loss: 1.6313 - acc: 0.5956 - ETA: 0s - loss: 1.6279 - acc: 0.5964 - ETA: 0s - loss: 1.6247 - acc: 0.5971Epoch 00000: val_loss improved from inf to 0.78113, saving model to saved_models/weights.best.ResNet50.hdf5
6680/6680 [==============================] - 29s - loss: 1.6238 - acc: 0.5970 - val_loss: 0.7811 - val_acc: 0.7605
Epoch 2/20
6660/6680 [============================>.] - ETA: 9s - loss: 0.2163 - acc: 1.0000 - ETA: 9s - loss: 0.3138 - acc: 0.9333 - ETA: 11s - loss: 0.3219 - acc: 0.9375 - ETA: 11s - loss: 0.3262 - acc: 0.9167 - ETA: 11s - loss: 0.3482 - acc: 0.9187 - ETA: 11s - loss: 0.3599 - acc: 0.9167 - ETA: 11s - loss: 0.3348 - acc: 0.9250 - ETA: 11s - loss: 0.3685 - acc: 0.9167 - ETA: 11s - loss: 0.3641 - acc: 0.9154 - ETA: 11s - loss: 0.3828 - acc: 0.9000 - ETA: 11s - loss: 0.4225 - acc: 0.8765 - ETA: 11s - loss: 0.4342 - acc: 0.8694 - ETA: 11s - loss: 0.4088 - acc: 0.8800 - ETA: 11s - loss: 0.4044 - acc: 0.8818 - ETA: 11s - loss: 0.4188 - acc: 0.8750 - ETA: 11s - loss: 0.4176 - acc: 0.8740 - ETA: 11s - loss: 0.4284 - acc: 0.8722 - ETA: 11s - loss: 0.4367 - acc: 0.8672 - ETA: 10s - loss: 0.4472 - acc: 0.8645 - ETA: 10s - loss: 0.4552 - acc: 0.8609 - ETA: 11s - loss: 0.4550 - acc: 0.8606 - ETA: 10s - loss: 0.4550 - acc: 0.8600 - ETA: 10s - loss: 0.4592 - acc: 0.8597 - ETA: 10s - loss: 0.4594 - acc: 0.8592 - ETA: 10s - loss: 0.4509 - acc: 0.8628 - ETA: 11s - loss: 0.4471 - acc: 0.8638 - ETA: 10s - loss: 0.4433 - acc: 0.8655 - ETA: 11s - loss: 0.4439 - acc: 0.8651 - ETA: 11s - loss: 0.4406 - acc: 0.8648 - ETA: 11s - loss: 0.4418 - acc: 0.8644 - ETA: 10s - loss: 0.4487 - acc: 0.8649 - ETA: 11s - loss: 0.4459 - acc: 0.8656 - ETA: 11s - loss: 0.4527 - acc: 0.8653 - ETA: 10s - loss: 0.4539 - acc: 0.8627 - ETA: 11s - loss: 0.4534 - acc: 0.8635 - ETA: 10s - loss: 0.4562 - acc: 0.8611 - ETA: 10s - loss: 0.4571 - acc: 0.8609 - ETA: 10s - loss: 0.4580 - acc: 0.8614 - ETA: 10s - loss: 0.4542 - acc: 0.8627 - ETA: 10s - loss: 0.4470 - acc: 0.8656 - ETA: 10s - loss: 0.4470 - acc: 0.8659 - ETA: 10s - loss: 0.4449 - acc: 0.8669 - ETA: 10s - loss: 0.4425 - acc: 0.8682 - ETA: 10s - loss: 0.4390 - acc: 0.8694 - ETA: 10s - loss: 0.4375 - acc: 0.8703 - ETA: 10s - loss: 0.4411 - acc: 0.8693 - ETA: 10s - loss: 0.4427 - acc: 0.8681 - ETA: 9s - loss: 0.4422 - acc: 0.8682  - ETA: 9s - loss: 0.4368 - acc: 0.8697 - ETA: 9s - loss: 0.4375 - acc: 0.8701 - ETA: 9s - loss: 0.4318 - acc: 0.8722 - ETA: 9s - loss: 0.4362 - acc: 0.8691 - ETA: 9s - loss: 0.4367 - acc: 0.8693 - ETA: 9s - loss: 0.4346 - acc: 0.8688 - ETA: 9s - loss: 0.4317 - acc: 0.8707 - ETA: 9s - loss: 0.4312 - acc: 0.8702 - ETA: 9s - loss: 0.4344 - acc: 0.8703 - ETA: 9s - loss: 0.4322 - acc: 0.8715 - ETA: 9s - loss: 0.4345 - acc: 0.8702 - ETA: 8s - loss: 0.4357 - acc: 0.8698 - ETA: 8s - loss: 0.4374 - acc: 0.8699 - ETA: 8s - loss: 0.4393 - acc: 0.8697 - ETA: 8s - loss: 0.4396 - acc: 0.8683 - ETA: 8s - loss: 0.4429 - acc: 0.8655 - ETA: 8s - loss: 0.4432 - acc: 0.8652 - ETA: 8s - loss: 0.4408 - acc: 0.8659 - ETA: 8s - loss: 0.4409 - acc: 0.8662 - ETA: 8s - loss: 0.4426 - acc: 0.8655 - ETA: 8s - loss: 0.4487 - acc: 0.8634 - ETA: 8s - loss: 0.4477 - acc: 0.8645 - ETA: 8s - loss: 0.4455 - acc: 0.8652 - ETA: 8s - loss: 0.4459 - acc: 0.8651 - ETA: 8s - loss: 0.4471 - acc: 0.8644 - ETA: 8s - loss: 0.4474 - acc: 0.8643 - ETA: 8s - loss: 0.4442 - acc: 0.8653 - ETA: 8s - loss: 0.4445 - acc: 0.8652 - ETA: 7s - loss: 0.4437 - acc: 0.8649 - ETA: 7s - loss: 0.4431 - acc: 0.8647 - ETA: 7s - loss: 0.4423 - acc: 0.8646 - ETA: 7s - loss: 0.4422 - acc: 0.8645 - ETA: 7s - loss: 0.4413 - acc: 0.8647 - ETA: 7s - loss: 0.4395 - acc: 0.8653 - ETA: 7s - loss: 0.4390 - acc: 0.8650 - ETA: 7s - loss: 0.4395 - acc: 0.8652 - ETA: 7s - loss: 0.4405 - acc: 0.8646 - ETA: 7s - loss: 0.4422 - acc: 0.8633 - ETA: 7s - loss: 0.4419 - acc: 0.8624 - ETA: 7s - loss: 0.4411 - acc: 0.8626 - ETA: 7s - loss: 0.4416 - acc: 0.8628 - ETA: 7s - loss: 0.4382 - acc: 0.8644 - ETA: 7s - loss: 0.4413 - acc: 0.8632 - ETA: 7s - loss: 0.4393 - acc: 0.8641 - ETA: 6s - loss: 0.4406 - acc: 0.8636 - ETA: 6s - loss: 0.4391 - acc: 0.8641 - ETA: 6s - loss: 0.4379 - acc: 0.8643 - ETA: 6s - loss: 0.4377 - acc: 0.8638 - ETA: 6s - loss: 0.4350 - acc: 0.8642 - ETA: 6s - loss: 0.4358 - acc: 0.8641 - ETA: 6s - loss: 0.4361 - acc: 0.8642 - ETA: 6s - loss: 0.4359 - acc: 0.8644 - ETA: 6s - loss: 0.4368 - acc: 0.8643 - ETA: 6s - loss: 0.4353 - acc: 0.8642 - ETA: 6s - loss: 0.4348 - acc: 0.8644 - ETA: 6s - loss: 0.4347 - acc: 0.8642 - ETA: 6s - loss: 0.4363 - acc: 0.8635 - ETA: 6s - loss: 0.4355 - acc: 0.8634 - ETA: 6s - loss: 0.4365 - acc: 0.8629 - ETA: 6s - loss: 0.4351 - acc: 0.8634 - ETA: 5s - loss: 0.4339 - acc: 0.8639 - ETA: 5s - loss: 0.4346 - acc: 0.8646 - ETA: 5s - loss: 0.4358 - acc: 0.8642 - ETA: 5s - loss: 0.4375 - acc: 0.8644 - ETA: 5s - loss: 0.4365 - acc: 0.8648 - ETA: 5s - loss: 0.4376 - acc: 0.8644 - ETA: 5s - loss: 0.4361 - acc: 0.8645 - ETA: 5s - loss: 0.4351 - acc: 0.8647 - ETA: 5s - loss: 0.4348 - acc: 0.8649 - ETA: 5s - loss: 0.4342 - acc: 0.8645 - ETA: 5s - loss: 0.4333 - acc: 0.8649 - ETA: 5s - loss: 0.4343 - acc: 0.8645 - ETA: 5s - loss: 0.4332 - acc: 0.8647 - ETA: 5s - loss: 0.4324 - acc: 0.8651 - ETA: 5s - loss: 0.4312 - acc: 0.8657 - ETA: 5s - loss: 0.4305 - acc: 0.8651 - ETA: 5s - loss: 0.4323 - acc: 0.8642 - ETA: 5s - loss: 0.4300 - acc: 0.8649 - ETA: 4s - loss: 0.4315 - acc: 0.8642 - ETA: 4s - loss: 0.4320 - acc: 0.8641 - ETA: 4s - loss: 0.4311 - acc: 0.8645 - ETA: 4s - loss: 0.4307 - acc: 0.8644 - ETA: 4s - loss: 0.4314 - acc: 0.8645 - ETA: 4s - loss: 0.4323 - acc: 0.8646 - ETA: 4s - loss: 0.4332 - acc: 0.8643 - ETA: 4s - loss: 0.4311 - acc: 0.8648 - ETA: 4s - loss: 0.4294 - acc: 0.8654 - ETA: 4s - loss: 0.4296 - acc: 0.8652 - ETA: 4s - loss: 0.4296 - acc: 0.8653 - ETA: 4s - loss: 0.4294 - acc: 0.8655 - ETA: 4s - loss: 0.4278 - acc: 0.8656 - ETA: 4s - loss: 0.4276 - acc: 0.8656 - ETA: 3s - loss: 0.4265 - acc: 0.8660 - ETA: 3s - loss: 0.4246 - acc: 0.8665 - ETA: 3s - loss: 0.4250 - acc: 0.8665 - ETA: 3s - loss: 0.4246 - acc: 0.8663 - ETA: 3s - loss: 0.4260 - acc: 0.8655 - ETA: 3s - loss: 0.4256 - acc: 0.8658 - ETA: 3s - loss: 0.4256 - acc: 0.8655 - ETA: 3s - loss: 0.4246 - acc: 0.8660 - ETA: 3s - loss: 0.4242 - acc: 0.8663 - ETA: 3s - loss: 0.4258 - acc: 0.8660 - ETA: 3s - loss: 0.4262 - acc: 0.8663 - ETA: 3s - loss: 0.4256 - acc: 0.8668 - ETA: 3s - loss: 0.4261 - acc: 0.8665 - ETA: 3s - loss: 0.4248 - acc: 0.8668 - ETA: 3s - loss: 0.4249 - acc: 0.8667 - ETA: 3s - loss: 0.4262 - acc: 0.8662 - ETA: 3s - loss: 0.4259 - acc: 0.8663 - ETA: 2s - loss: 0.4256 - acc: 0.8665 - ETA: 2s - loss: 0.4269 - acc: 0.8658 - ETA: 2s - loss: 0.4264 - acc: 0.8661 - ETA: 2s - loss: 0.4261 - acc: 0.8662 - ETA: 2s - loss: 0.4256 - acc: 0.8666 - ETA: 2s - loss: 0.4253 - acc: 0.8667 - ETA: 2s - loss: 0.4278 - acc: 0.8658 - ETA: 2s - loss: 0.4288 - acc: 0.8655 - ETA: 2s - loss: 0.4283 - acc: 0.8655 - ETA: 2s - loss: 0.4274 - acc: 0.8656 - ETA: 2s - loss: 0.4280 - acc: 0.8651 - ETA: 2s - loss: 0.4278 - acc: 0.8652 - ETA: 2s - loss: 0.4282 - acc: 0.8647 - ETA: 2s - loss: 0.4281 - acc: 0.8646 - ETA: 2s - loss: 0.4279 - acc: 0.8647 - ETA: 2s - loss: 0.4260 - acc: 0.8655 - ETA: 1s - loss: 0.4272 - acc: 0.8647 - ETA: 1s - loss: 0.4275 - acc: 0.8647 - ETA: 1s - loss: 0.4268 - acc: 0.8646 - ETA: 1s - loss: 0.4267 - acc: 0.8650 - ETA: 1s - loss: 0.4268 - acc: 0.8649 - ETA: 1s - loss: 0.4262 - acc: 0.8652 - ETA: 1s - loss: 0.4257 - acc: 0.8652 - ETA: 1s - loss: 0.4267 - acc: 0.8652 - ETA: 1s - loss: 0.4267 - acc: 0.8650 - ETA: 1s - loss: 0.4284 - acc: 0.8649 - ETA: 1s - loss: 0.4290 - acc: 0.8650 - ETA: 1s - loss: 0.4280 - acc: 0.8656 - ETA: 1s - loss: 0.4278 - acc: 0.8658 - ETA: 1s - loss: 0.4285 - acc: 0.8657 - ETA: 1s - loss: 0.4286 - acc: 0.8658 - ETA: 1s - loss: 0.4283 - acc: 0.8661 - ETA: 1s - loss: 0.4276 - acc: 0.8662 - ETA: 0s - loss: 0.4275 - acc: 0.8661 - ETA: 0s - loss: 0.4284 - acc: 0.8659 - ETA: 0s - loss: 0.4291 - acc: 0.8656 - ETA: 0s - loss: 0.4299 - acc: 0.8653 - ETA: 0s - loss: 0.4318 - acc: 0.8646 - ETA: 0s - loss: 0.4311 - acc: 0.8649 - ETA: 0s - loss: 0.4335 - acc: 0.8643 - ETA: 0s - loss: 0.4332 - acc: 0.8645 - ETA: 0s - loss: 0.4318 - acc: 0.8651 - ETA: 0s - loss: 0.4326 - acc: 0.8646 - ETA: 0s - loss: 0.4336 - acc: 0.8645 - ETA: 0s - loss: 0.4349 - acc: 0.8641 - ETA: 0s - loss: 0.4341 - acc: 0.8643 - ETA: 0s - loss: 0.4342 - acc: 0.8642 - ETA: 0s - loss: 0.4347 - acc: 0.8644Epoch 00001: val_loss improved from 0.78113 to 0.69550, saving model to saved_models/weights.best.ResNet50.hdf5
6680/6680 [==============================] - 12s - loss: 0.4341 - acc: 0.8645 - val_loss: 0.6955 - val_acc: 0.7892
Epoch 3/20
6660/6680 [============================>.] - ETA: 6s - loss: 0.2693 - acc: 0.9000 - ETA: 9s - loss: 0.2175 - acc: 0.9500 - ETA: 9s - loss: 0.2774 - acc: 0.9400 - ETA: 10s - loss: 0.2963 - acc: 0.9250 - ETA: 11s - loss: 0.2809 - acc: 0.9250 - ETA: 11s - loss: 0.2587 - acc: 0.9350 - ETA: 11s - loss: 0.2505 - acc: 0.9333 - ETA: 10s - loss: 0.2538 - acc: 0.9286 - ETA: 11s - loss: 0.2414 - acc: 0.9300 - ETA: 11s - loss: 0.2263 - acc: 0.9353 - ETA: 10s - loss: 0.2255 - acc: 0.9368 - ETA: 10s - loss: 0.2213 - acc: 0.9381 - ETA: 10s - loss: 0.2262 - acc: 0.9386 - ETA: 10s - loss: 0.2207 - acc: 0.9396 - ETA: 10s - loss: 0.2242 - acc: 0.9346 - ETA: 10s - loss: 0.2140 - acc: 0.9393 - ETA: 10s - loss: 0.2199 - acc: 0.9397 - ETA: 10s - loss: 0.2250 - acc: 0.9355 - ETA: 10s - loss: 0.2350 - acc: 0.9333 - ETA: 10s - loss: 0.2364 - acc: 0.9309 - ETA: 10s - loss: 0.2368 - acc: 0.9306 - ETA: 10s - loss: 0.2394 - acc: 0.9276 - ETA: 10s - loss: 0.2363 - acc: 0.9295 - ETA: 10s - loss: 0.2466 - acc: 0.9256 - ETA: 10s - loss: 0.2450 - acc: 0.9262 - ETA: 10s - loss: 0.2459 - acc: 0.9250 - ETA: 10s - loss: 0.2430 - acc: 0.9261 - ETA: 10s - loss: 0.2408 - acc: 0.9271 - ETA: 10s - loss: 0.2454 - acc: 0.9260 - ETA: 10s - loss: 0.2503 - acc: 0.9265 - ETA: 10s - loss: 0.2449 - acc: 0.9283 - ETA: 9s - loss: 0.2442 - acc: 0.9291  - ETA: 9s - loss: 0.2459 - acc: 0.9289 - ETA: 9s - loss: 0.2495 - acc: 0.9284 - ETA: 9s - loss: 0.2475 - acc: 0.9288 - ETA: 9s - loss: 0.2522 - acc: 0.9254 - ETA: 9s - loss: 0.2487 - acc: 0.9266 - ETA: 9s - loss: 0.2516 - acc: 0.9242 - ETA: 9s - loss: 0.2509 - acc: 0.9250 - ETA: 9s - loss: 0.2489 - acc: 0.9257 - ETA: 9s - loss: 0.2470 - acc: 0.9257 - ETA: 9s - loss: 0.2444 - acc: 0.9268 - ETA: 9s - loss: 0.2410 - acc: 0.9281 - ETA: 9s - loss: 0.2400 - acc: 0.9284 - ETA: 9s - loss: 0.2399 - acc: 0.9289 - ETA: 9s - loss: 0.2434 - acc: 0.9269 - ETA: 9s - loss: 0.2421 - acc: 0.9272 - ETA: 9s - loss: 0.2382 - acc: 0.9290 - ETA: 9s - loss: 0.2348 - acc: 0.9301 - ETA: 9s - loss: 0.2379 - acc: 0.9286 - ETA: 8s - loss: 0.2373 - acc: 0.9291 - ETA: 8s - loss: 0.2401 - acc: 0.9290 - ETA: 8s - loss: 0.2393 - acc: 0.9289 - ETA: 8s - loss: 0.2413 - acc: 0.9272 - ETA: 8s - loss: 0.2409 - acc: 0.9277 - ETA: 8s - loss: 0.2406 - acc: 0.9274 - ETA: 8s - loss: 0.2398 - acc: 0.9281 - ETA: 8s - loss: 0.2400 - acc: 0.9276 - ETA: 8s - loss: 0.2399 - acc: 0.9275 - ETA: 8s - loss: 0.2407 - acc: 0.9272 - ETA: 8s - loss: 0.2392 - acc: 0.9272 - ETA: 8s - loss: 0.2379 - acc: 0.9279 - ETA: 8s - loss: 0.2363 - acc: 0.9286 - ETA: 8s - loss: 0.2354 - acc: 0.9285 - ETA: 8s - loss: 0.2329 - acc: 0.9294 - ETA: 8s - loss: 0.2326 - acc: 0.9295 - ETA: 8s - loss: 0.2322 - acc: 0.9299 - ETA: 8s - loss: 0.2316 - acc: 0.9301 - ETA: 8s - loss: 0.2302 - acc: 0.9307 - ETA: 8s - loss: 0.2311 - acc: 0.9304 - ETA: 7s - loss: 0.2295 - acc: 0.9308 - ETA: 7s - loss: 0.2311 - acc: 0.9305 - ETA: 7s - loss: 0.2302 - acc: 0.9312 - ETA: 7s - loss: 0.2319 - acc: 0.9306 - ETA: 7s - loss: 0.2326 - acc: 0.9307 - ETA: 7s - loss: 0.2333 - acc: 0.9309 - ETA: 7s - loss: 0.2336 - acc: 0.9312 - ETA: 7s - loss: 0.2326 - acc: 0.9313 - ETA: 7s - loss: 0.2309 - acc: 0.9324 - ETA: 7s - loss: 0.2348 - acc: 0.9312 - ETA: 7s - loss: 0.2352 - acc: 0.9303 - ETA: 7s - loss: 0.2343 - acc: 0.9308 - ETA: 7s - loss: 0.2335 - acc: 0.9313 - ETA: 7s - loss: 0.2322 - acc: 0.9319 - ETA: 7s - loss: 0.2326 - acc: 0.9321 - ETA: 7s - loss: 0.2307 - acc: 0.9327 - ETA: 7s - loss: 0.2315 - acc: 0.9319 - ETA: 7s - loss: 0.2324 - acc: 0.9318 - ETA: 7s - loss: 0.2333 - acc: 0.9314 - ETA: 6s - loss: 0.2350 - acc: 0.9306 - ETA: 6s - loss: 0.2400 - acc: 0.9294 - ETA: 6s - loss: 0.2395 - acc: 0.9293 - ETA: 6s - loss: 0.2392 - acc: 0.9291 - ETA: 6s - loss: 0.2377 - acc: 0.9301 - ETA: 6s - loss: 0.2379 - acc: 0.9300 - ETA: 6s - loss: 0.2377 - acc: 0.9293 - ETA: 6s - loss: 0.2369 - acc: 0.9292 - ETA: 6s - loss: 0.2367 - acc: 0.9294 - ETA: 6s - loss: 0.2373 - acc: 0.9287 - ETA: 6s - loss: 0.2373 - acc: 0.9290 - ETA: 6s - loss: 0.2367 - acc: 0.9292 - ETA: 6s - loss: 0.2377 - acc: 0.9295 - ETA: 6s - loss: 0.2377 - acc: 0.9294 - ETA: 6s - loss: 0.2396 - acc: 0.9287 - ETA: 5s - loss: 0.2401 - acc: 0.9286 - ETA: 5s - loss: 0.2397 - acc: 0.9286 - ETA: 5s - loss: 0.2396 - acc: 0.9287 - ETA: 5s - loss: 0.2395 - acc: 0.9288 - ETA: 5s - loss: 0.2417 - acc: 0.9271 - ETA: 5s - loss: 0.2409 - acc: 0.9275 - ETA: 5s - loss: 0.2412 - acc: 0.9271 - ETA: 5s - loss: 0.2416 - acc: 0.9269 - ETA: 5s - loss: 0.2424 - acc: 0.9265 - ETA: 5s - loss: 0.2424 - acc: 0.9264 - ETA: 5s - loss: 0.2432 - acc: 0.9262 - ETA: 5s - loss: 0.2440 - acc: 0.9258 - ETA: 5s - loss: 0.2453 - acc: 0.9257 - ETA: 5s - loss: 0.2455 - acc: 0.9257 - ETA: 5s - loss: 0.2462 - acc: 0.9257 - ETA: 5s - loss: 0.2453 - acc: 0.9258 - ETA: 5s - loss: 0.2471 - acc: 0.9255 - ETA: 5s - loss: 0.2468 - acc: 0.9256 - ETA: 5s - loss: 0.2477 - acc: 0.9253 - ETA: 5s - loss: 0.2488 - acc: 0.9249 - ETA: 5s - loss: 0.2481 - acc: 0.9251 - ETA: 5s - loss: 0.2500 - acc: 0.9239 - ETA: 4s - loss: 0.2500 - acc: 0.9238 - ETA: 4s - loss: 0.2503 - acc: 0.9238 - ETA: 4s - loss: 0.2517 - acc: 0.9235 - ETA: 4s - loss: 0.2550 - acc: 0.9222 - ETA: 4s - loss: 0.2546 - acc: 0.9222 - ETA: 4s - loss: 0.2547 - acc: 0.9223 - ETA: 4s - loss: 0.2550 - acc: 0.9223 - ETA: 4s - loss: 0.2553 - acc: 0.9222 - ETA: 4s - loss: 0.2555 - acc: 0.9221 - ETA: 4s - loss: 0.2560 - acc: 0.9221 - ETA: 4s - loss: 0.2560 - acc: 0.9221 - ETA: 4s - loss: 0.2565 - acc: 0.9217 - ETA: 4s - loss: 0.2587 - acc: 0.9206 - ETA: 4s - loss: 0.2583 - acc: 0.9204 - ETA: 4s - loss: 0.2573 - acc: 0.9207 - ETA: 3s - loss: 0.2573 - acc: 0.9205 - ETA: 3s - loss: 0.2592 - acc: 0.9203 - ETA: 3s - loss: 0.2596 - acc: 0.9200 - ETA: 3s - loss: 0.2592 - acc: 0.9200 - ETA: 3s - loss: 0.2595 - acc: 0.9194 - ETA: 3s - loss: 0.2596 - acc: 0.9192 - ETA: 3s - loss: 0.2600 - acc: 0.9191 - ETA: 3s - loss: 0.2610 - acc: 0.9191 - ETA: 3s - loss: 0.2604 - acc: 0.9194 - ETA: 3s - loss: 0.2606 - acc: 0.9196 - ETA: 3s - loss: 0.2598 - acc: 0.9200 - ETA: 3s - loss: 0.2588 - acc: 0.9204 - ETA: 3s - loss: 0.2582 - acc: 0.9207 - ETA: 3s - loss: 0.2587 - acc: 0.9204 - ETA: 3s - loss: 0.2582 - acc: 0.9208 - ETA: 2s - loss: 0.2573 - acc: 0.9210 - ETA: 2s - loss: 0.2575 - acc: 0.9209 - ETA: 2s - loss: 0.2581 - acc: 0.9208 - ETA: 2s - loss: 0.2605 - acc: 0.9199 - ETA: 2s - loss: 0.2611 - acc: 0.9196 - ETA: 2s - loss: 0.2604 - acc: 0.9199 - ETA: 2s - loss: 0.2610 - acc: 0.9196 - ETA: 2s - loss: 0.2613 - acc: 0.9196 - ETA: 2s - loss: 0.2620 - acc: 0.9195 - ETA: 2s - loss: 0.2628 - acc: 0.9193 - ETA: 2s - loss: 0.2622 - acc: 0.9196 - ETA: 2s - loss: 0.2612 - acc: 0.9198 - ETA: 2s - loss: 0.2613 - acc: 0.9200 - ETA: 2s - loss: 0.2623 - acc: 0.9194 - ETA: 2s - loss: 0.2631 - acc: 0.9191 - ETA: 2s - loss: 0.2627 - acc: 0.9190 - ETA: 2s - loss: 0.2639 - acc: 0.9185 - ETA: 1s - loss: 0.2635 - acc: 0.9185 - ETA: 1s - loss: 0.2635 - acc: 0.9184 - ETA: 1s - loss: 0.2631 - acc: 0.9187 - ETA: 1s - loss: 0.2632 - acc: 0.9184 - ETA: 1s - loss: 0.2633 - acc: 0.9185 - ETA: 1s - loss: 0.2631 - acc: 0.9182 - ETA: 1s - loss: 0.2623 - acc: 0.9186 - ETA: 1s - loss: 0.2632 - acc: 0.9183 - ETA: 1s - loss: 0.2624 - acc: 0.9185 - ETA: 1s - loss: 0.2624 - acc: 0.9186 - ETA: 1s - loss: 0.2625 - acc: 0.9185 - ETA: 1s - loss: 0.2635 - acc: 0.9182 - ETA: 1s - loss: 0.2645 - acc: 0.9178 - ETA: 1s - loss: 0.2645 - acc: 0.9178 - ETA: 1s - loss: 0.2633 - acc: 0.9184 - ETA: 1s - loss: 0.2623 - acc: 0.9187 - ETA: 0s - loss: 0.2639 - acc: 0.9181 - ETA: 0s - loss: 0.2627 - acc: 0.9186 - ETA: 0s - loss: 0.2624 - acc: 0.9185 - ETA: 0s - loss: 0.2624 - acc: 0.9184 - ETA: 0s - loss: 0.2633 - acc: 0.9181 - ETA: 0s - loss: 0.2633 - acc: 0.9179 - ETA: 0s - loss: 0.2630 - acc: 0.9178 - ETA: 0s - loss: 0.2629 - acc: 0.9175 - ETA: 0s - loss: 0.2639 - acc: 0.9169 - ETA: 0s - loss: 0.2648 - acc: 0.9165 - ETA: 0s - loss: 0.2657 - acc: 0.9163 - ETA: 0s - loss: 0.2665 - acc: 0.9162 - ETA: 0s - loss: 0.2670 - acc: 0.9159Epoch 00002: val_loss improved from 0.69550 to 0.66123, saving model to saved_models/weights.best.ResNet50.hdf5
6680/6680 [==============================] - 12s - loss: 0.2665 - acc: 0.9160 - val_loss: 0.6612 - val_acc: 0.7904
Epoch 4/20
6640/6680 [============================>.] - ETA: 13s - loss: 0.0349 - acc: 1.0000 - ETA: 14s - loss: 0.0835 - acc: 0.9750 - ETA: 13s - loss: 0.0670 - acc: 0.9875 - ETA: 12s - loss: 0.1683 - acc: 0.9583 - ETA: 12s - loss: 0.1549 - acc: 0.9625 - ETA: 11s - loss: 0.1363 - acc: 0.9650 - ETA: 12s - loss: 0.1345 - acc: 0.9682 - ETA: 12s - loss: 0.1450 - acc: 0.9625 - ETA: 12s - loss: 0.1433 - acc: 0.9615 - ETA: 13s - loss: 0.1671 - acc: 0.9571 - ETA: 12s - loss: 0.1716 - acc: 0.9531 - ETA: 12s - loss: 0.1639 - acc: 0.9528 - ETA: 12s - loss: 0.1565 - acc: 0.9553 - ETA: 12s - loss: 0.1526 - acc: 0.9575 - ETA: 12s - loss: 0.1481 - acc: 0.9595 - ETA: 12s - loss: 0.1401 - acc: 0.9630 - ETA: 12s - loss: 0.1368 - acc: 0.9600 - ETA: 12s - loss: 0.1458 - acc: 0.9574 - ETA: 12s - loss: 0.1413 - acc: 0.9589 - ETA: 12s - loss: 0.1393 - acc: 0.9603 - ETA: 12s - loss: 0.1481 - acc: 0.9565 - ETA: 12s - loss: 0.1513 - acc: 0.9561 - ETA: 11s - loss: 0.1564 - acc: 0.9543 - ETA: 12s - loss: 0.1661 - acc: 0.9486 - ETA: 11s - loss: 0.1616 - acc: 0.9500 - ETA: 11s - loss: 0.1640 - acc: 0.9500 - ETA: 11s - loss: 0.1657 - acc: 0.9500 - ETA: 12s - loss: 0.1638 - acc: 0.9512 - ETA: 12s - loss: 0.1607 - acc: 0.9524 - ETA: 11s - loss: 0.1608 - acc: 0.9523 - ETA: 11s - loss: 0.1602 - acc: 0.9511 - ETA: 11s - loss: 0.1593 - acc: 0.9511 - ETA: 11s - loss: 0.1647 - acc: 0.9469 - ETA: 11s - loss: 0.1696 - acc: 0.9461 - ETA: 11s - loss: 0.1676 - acc: 0.9471 - ETA: 11s - loss: 0.1670 - acc: 0.9481 - ETA: 11s - loss: 0.1657 - acc: 0.9482 - ETA: 11s - loss: 0.1704 - acc: 0.9474 - ETA: 11s - loss: 0.1684 - acc: 0.9474 - ETA: 10s - loss: 0.1716 - acc: 0.9458 - ETA: 10s - loss: 0.1722 - acc: 0.9459 - ETA: 10s - loss: 0.1749 - acc: 0.9452 - ETA: 10s - loss: 0.1799 - acc: 0.9445 - ETA: 10s - loss: 0.1806 - acc: 0.9447 - ETA: 10s - loss: 0.1803 - acc: 0.9441 - ETA: 10s - loss: 0.1807 - acc: 0.9435 - ETA: 10s - loss: 0.1809 - acc: 0.9437 - ETA: 10s - loss: 0.1788 - acc: 0.9445 - ETA: 10s - loss: 0.1752 - acc: 0.9460 - ETA: 10s - loss: 0.1768 - acc: 0.9454 - ETA: 10s - loss: 0.1835 - acc: 0.9442 - ETA: 9s - loss: 0.1892 - acc: 0.9437  - ETA: 9s - loss: 0.1868 - acc: 0.9451 - ETA: 9s - loss: 0.1861 - acc: 0.9452 - ETA: 9s - loss: 0.1887 - acc: 0.9453 - ETA: 9s - loss: 0.1895 - acc: 0.9442 - ETA: 9s - loss: 0.1873 - acc: 0.9449 - ETA: 9s - loss: 0.1856 - acc: 0.9455 - ETA: 9s - loss: 0.1845 - acc: 0.9456 - ETA: 9s - loss: 0.1834 - acc: 0.9456 - ETA: 9s - loss: 0.1834 - acc: 0.9451 - ETA: 9s - loss: 0.1813 - acc: 0.9463 - ETA: 9s - loss: 0.1797 - acc: 0.9468 - ETA: 9s - loss: 0.1798 - acc: 0.9469 - ETA: 9s - loss: 0.1783 - acc: 0.9469 - ETA: 9s - loss: 0.1791 - acc: 0.9465 - ETA: 9s - loss: 0.1801 - acc: 0.9461 - ETA: 9s - loss: 0.1809 - acc: 0.9456 - ETA: 9s - loss: 0.1801 - acc: 0.9462 - ETA: 8s - loss: 0.1781 - acc: 0.9467 - ETA: 8s - loss: 0.1783 - acc: 0.9468 - ETA: 8s - loss: 0.1764 - acc: 0.9473 - ETA: 8s - loss: 0.1758 - acc: 0.9473 - ETA: 8s - loss: 0.1745 - acc: 0.9478 - ETA: 8s - loss: 0.1743 - acc: 0.9478 - ETA: 8s - loss: 0.1731 - acc: 0.9483 - ETA: 8s - loss: 0.1727 - acc: 0.9487 - ETA: 8s - loss: 0.1723 - acc: 0.9492 - ETA: 8s - loss: 0.1705 - acc: 0.9496 - ETA: 8s - loss: 0.1698 - acc: 0.9496 - ETA: 8s - loss: 0.1699 - acc: 0.9492 - ETA: 8s - loss: 0.1691 - acc: 0.9496 - ETA: 8s - loss: 0.1698 - acc: 0.9496 - ETA: 7s - loss: 0.1693 - acc: 0.9500 - ETA: 7s - loss: 0.1702 - acc: 0.9500 - ETA: 7s - loss: 0.1683 - acc: 0.9508 - ETA: 7s - loss: 0.1667 - acc: 0.9511 - ETA: 7s - loss: 0.1658 - acc: 0.9515 - ETA: 7s - loss: 0.1664 - acc: 0.9515 - ETA: 7s - loss: 0.1662 - acc: 0.9515 - ETA: 7s - loss: 0.1653 - acc: 0.9514 - ETA: 7s - loss: 0.1649 - acc: 0.9514 - ETA: 7s - loss: 0.1646 - acc: 0.9518 - ETA: 7s - loss: 0.1637 - acc: 0.9521 - ETA: 7s - loss: 0.1625 - acc: 0.9524 - ETA: 7s - loss: 0.1631 - acc: 0.9521 - ETA: 7s - loss: 0.1641 - acc: 0.9514 - ETA: 7s - loss: 0.1636 - acc: 0.9517 - ETA: 7s - loss: 0.1637 - acc: 0.9513 - ETA: 7s - loss: 0.1651 - acc: 0.9510 - ETA: 7s - loss: 0.1648 - acc: 0.9510 - ETA: 7s - loss: 0.1653 - acc: 0.9510 - ETA: 7s - loss: 0.1654 - acc: 0.9510 - ETA: 7s - loss: 0.1647 - acc: 0.9513 - ETA: 7s - loss: 0.1653 - acc: 0.9503 - ETA: 7s - loss: 0.1673 - acc: 0.9494 - ETA: 6s - loss: 0.1683 - acc: 0.9491 - ETA: 6s - loss: 0.1689 - acc: 0.9484 - ETA: 6s - loss: 0.1680 - acc: 0.9488 - ETA: 6s - loss: 0.1684 - acc: 0.9482 - ETA: 6s - loss: 0.1677 - acc: 0.9485 - ETA: 6s - loss: 0.1680 - acc: 0.9476 - ETA: 6s - loss: 0.1695 - acc: 0.9473 - ETA: 6s - loss: 0.1693 - acc: 0.9474 - ETA: 6s - loss: 0.1689 - acc: 0.9474 - ETA: 6s - loss: 0.1682 - acc: 0.9480 - ETA: 6s - loss: 0.1682 - acc: 0.9477 - ETA: 6s - loss: 0.1671 - acc: 0.9480 - ETA: 6s - loss: 0.1667 - acc: 0.9483 - ETA: 6s - loss: 0.1667 - acc: 0.9481 - ETA: 5s - loss: 0.1664 - acc: 0.9481 - ETA: 5s - loss: 0.1669 - acc: 0.9481 - ETA: 5s - loss: 0.1660 - acc: 0.9481 - ETA: 5s - loss: 0.1670 - acc: 0.9481 - ETA: 5s - loss: 0.1662 - acc: 0.9484 - ETA: 5s - loss: 0.1654 - acc: 0.9487 - ETA: 5s - loss: 0.1681 - acc: 0.9487 - ETA: 5s - loss: 0.1689 - acc: 0.9484 - ETA: 5s - loss: 0.1712 - acc: 0.9479 - ETA: 5s - loss: 0.1708 - acc: 0.9482 - ETA: 5s - loss: 0.1715 - acc: 0.9480 - ETA: 5s - loss: 0.1710 - acc: 0.9480 - ETA: 5s - loss: 0.1714 - acc: 0.9480 - ETA: 5s - loss: 0.1716 - acc: 0.9478 - ETA: 5s - loss: 0.1716 - acc: 0.9478 - ETA: 4s - loss: 0.1708 - acc: 0.9478 - ETA: 4s - loss: 0.1710 - acc: 0.9478 - ETA: 4s - loss: 0.1704 - acc: 0.9481 - ETA: 4s - loss: 0.1703 - acc: 0.9481 - ETA: 4s - loss: 0.1701 - acc: 0.9481 - ETA: 4s - loss: 0.1717 - acc: 0.9474 - ETA: 4s - loss: 0.1721 - acc: 0.9470 - ETA: 4s - loss: 0.1714 - acc: 0.9472 - ETA: 4s - loss: 0.1722 - acc: 0.9468 - ETA: 4s - loss: 0.1721 - acc: 0.9468 - ETA: 4s - loss: 0.1737 - acc: 0.9459 - ETA: 4s - loss: 0.1740 - acc: 0.9459 - ETA: 4s - loss: 0.1744 - acc: 0.9458 - ETA: 4s - loss: 0.1746 - acc: 0.9456 - ETA: 4s - loss: 0.1748 - acc: 0.9456 - ETA: 4s - loss: 0.1742 - acc: 0.9459 - ETA: 4s - loss: 0.1739 - acc: 0.9459 - ETA: 3s - loss: 0.1739 - acc: 0.9459 - ETA: 3s - loss: 0.1737 - acc: 0.9459 - ETA: 3s - loss: 0.1729 - acc: 0.9462 - ETA: 3s - loss: 0.1723 - acc: 0.9464 - ETA: 3s - loss: 0.1717 - acc: 0.9466 - ETA: 3s - loss: 0.1713 - acc: 0.9469 - ETA: 3s - loss: 0.1710 - acc: 0.9469 - ETA: 3s - loss: 0.1707 - acc: 0.9471 - ETA: 3s - loss: 0.1709 - acc: 0.9467 - ETA: 3s - loss: 0.1709 - acc: 0.9468 - ETA: 3s - loss: 0.1708 - acc: 0.9466 - ETA: 3s - loss: 0.1703 - acc: 0.9468 - ETA: 3s - loss: 0.1709 - acc: 0.9464 - ETA: 3s - loss: 0.1719 - acc: 0.9460 - ETA: 3s - loss: 0.1713 - acc: 0.9463 - ETA: 2s - loss: 0.1705 - acc: 0.9463 - ETA: 2s - loss: 0.1702 - acc: 0.9463 - ETA: 2s - loss: 0.1705 - acc: 0.9465 - ETA: 2s - loss: 0.1707 - acc: 0.9466 - ETA: 2s - loss: 0.1717 - acc: 0.9464 - ETA: 2s - loss: 0.1712 - acc: 0.9466 - ETA: 2s - loss: 0.1713 - acc: 0.9464 - ETA: 2s - loss: 0.1714 - acc: 0.9463 - ETA: 2s - loss: 0.1726 - acc: 0.9459 - ETA: 2s - loss: 0.1731 - acc: 0.9457 - ETA: 2s - loss: 0.1729 - acc: 0.9458 - ETA: 2s - loss: 0.1727 - acc: 0.9460 - ETA: 2s - loss: 0.1729 - acc: 0.9458 - ETA: 2s - loss: 0.1739 - acc: 0.9454 - ETA: 2s - loss: 0.1745 - acc: 0.9453 - ETA: 2s - loss: 0.1752 - acc: 0.9450 - ETA: 2s - loss: 0.1752 - acc: 0.9448 - ETA: 2s - loss: 0.1750 - acc: 0.9450 - ETA: 2s - loss: 0.1746 - acc: 0.9452 - ETA: 1s - loss: 0.1742 - acc: 0.9454 - ETA: 1s - loss: 0.1738 - acc: 0.9456 - ETA: 1s - loss: 0.1741 - acc: 0.9455 - ETA: 1s - loss: 0.1739 - acc: 0.9453 - ETA: 1s - loss: 0.1735 - acc: 0.9455 - ETA: 1s - loss: 0.1731 - acc: 0.9456 - ETA: 1s - loss: 0.1730 - acc: 0.9456 - ETA: 1s - loss: 0.1729 - acc: 0.9456 - ETA: 1s - loss: 0.1729 - acc: 0.9454 - ETA: 1s - loss: 0.1738 - acc: 0.9451 - ETA: 1s - loss: 0.1753 - acc: 0.9450 - ETA: 1s - loss: 0.1754 - acc: 0.9445 - ETA: 1s - loss: 0.1750 - acc: 0.9447 - ETA: 1s - loss: 0.1751 - acc: 0.9446 - ETA: 1s - loss: 0.1753 - acc: 0.9445 - ETA: 1s - loss: 0.1751 - acc: 0.9445 - ETA: 0s - loss: 0.1764 - acc: 0.9437 - ETA: 0s - loss: 0.1760 - acc: 0.9437 - ETA: 0s - loss: 0.1757 - acc: 0.9439 - ETA: 0s - loss: 0.1752 - acc: 0.9441 - ETA: 0s - loss: 0.1757 - acc: 0.9443 - ETA: 0s - loss: 0.1765 - acc: 0.9436 - ETA: 0s - loss: 0.1769 - acc: 0.9436 - ETA: 0s - loss: 0.1779 - acc: 0.9436 - ETA: 0s - loss: 0.1778 - acc: 0.9437 - ETA: 0s - loss: 0.1777 - acc: 0.9434 - ETA: 0s - loss: 0.1773 - acc: 0.9434 - ETA: 0s - loss: 0.1765 - acc: 0.9436 - ETA: 0s - loss: 0.1767 - acc: 0.9436 - ETA: 0s - loss: 0.1764 - acc: 0.9438Epoch 00003: val_loss improved from 0.66123 to 0.60091, saving model to saved_models/weights.best.ResNet50.hdf5
6680/6680 [==============================] - 13s - loss: 0.1763 - acc: 0.9437 - val_loss: 0.6009 - val_acc: 0.8192
Epoch 5/20
6640/6680 [============================>.] - ETA: 6s - loss: 0.1198 - acc: 0.9500 - ETA: 8s - loss: 0.0644 - acc: 0.9833 - ETA: 10s - loss: 0.0634 - acc: 0.9750 - ETA: 10s - loss: 0.0663 - acc: 0.9667 - ETA: 10s - loss: 0.1067 - acc: 0.9500 - ETA: 11s - loss: 0.1063 - acc: 0.9500 - ETA: 11s - loss: 0.0974 - acc: 0.9550 - ETA: 11s - loss: 0.1045 - acc: 0.9583 - ETA: 11s - loss: 0.1007 - acc: 0.9643 - ETA: 11s - loss: 0.1116 - acc: 0.9600 - ETA: 11s - loss: 0.1016 - acc: 0.9647 - ETA: 11s - loss: 0.0983 - acc: 0.9667 - ETA: 11s - loss: 0.1010 - acc: 0.9650 - ETA: 11s - loss: 0.1043 - acc: 0.9614 - ETA: 11s - loss: 0.1017 - acc: 0.9630 - ETA: 11s - loss: 0.1001 - acc: 0.9646 - ETA: 11s - loss: 0.0964 - acc: 0.9654 - ETA: 11s - loss: 0.1014 - acc: 0.9630 - ETA: 11s - loss: 0.0998 - acc: 0.9643 - ETA: 11s - loss: 0.0983 - acc: 0.9650 - ETA: 11s - loss: 0.1014 - acc: 0.9656 - ETA: 11s - loss: 0.1007 - acc: 0.9652 - ETA: 11s - loss: 0.0972 - acc: 0.9671 - ETA: 11s - loss: 0.1041 - acc: 0.9653 - ETA: 10s - loss: 0.1054 - acc: 0.9658 - ETA: 10s - loss: 0.1044 - acc: 0.9667 - ETA: 10s - loss: 0.1019 - acc: 0.9683 - ETA: 10s - loss: 0.1023 - acc: 0.9674 - ETA: 10s - loss: 0.1020 - acc: 0.9670 - ETA: 10s - loss: 0.1007 - acc: 0.9678 - ETA: 10s - loss: 0.1034 - acc: 0.9674 - ETA: 10s - loss: 0.1054 - acc: 0.9660 - ETA: 10s - loss: 0.1037 - acc: 0.9667 - ETA: 10s - loss: 0.1050 - acc: 0.9663 - ETA: 11s - loss: 0.1067 - acc: 0.9650 - ETA: 11s - loss: 0.1049 - acc: 0.9657 - ETA: 11s - loss: 0.1039 - acc: 0.9663 - ETA: 10s - loss: 0.1015 - acc: 0.9676 - ETA: 10s - loss: 0.0999 - acc: 0.9679 - ETA: 10s - loss: 0.0996 - acc: 0.9675 - ETA: 10s - loss: 0.0980 - acc: 0.9681 - ETA: 10s - loss: 0.0969 - acc: 0.9683 - ETA: 10s - loss: 0.1004 - acc: 0.9664 - ETA: 10s - loss: 0.1007 - acc: 0.9661 - ETA: 10s - loss: 0.0986 - acc: 0.9672 - ETA: 10s - loss: 0.0980 - acc: 0.9677 - ETA: 10s - loss: 0.0974 - acc: 0.9674 - ETA: 10s - loss: 0.0964 - acc: 0.9684 - ETA: 10s - loss: 0.0957 - acc: 0.9688 - ETA: 10s - loss: 0.1005 - acc: 0.9662 - ETA: 10s - loss: 0.1000 - acc: 0.9664 - ETA: 10s - loss: 0.0994 - acc: 0.9662 - ETA: 10s - loss: 0.0984 - acc: 0.9664 - ETA: 10s - loss: 0.0982 - acc: 0.9669 - ETA: 10s - loss: 0.0980 - acc: 0.9667 - ETA: 10s - loss: 0.0974 - acc: 0.9671 - ETA: 9s - loss: 0.0986 - acc: 0.9667  - ETA: 9s - loss: 0.0987 - acc: 0.9665 - ETA: 9s - loss: 0.0983 - acc: 0.9667 - ETA: 9s - loss: 0.0981 - acc: 0.9669 - ETA: 9s - loss: 0.0981 - acc: 0.9670 - ETA: 9s - loss: 0.0995 - acc: 0.9669 - ETA: 9s - loss: 0.0988 - acc: 0.9672 - ETA: 9s - loss: 0.0985 - acc: 0.9674 - ETA: 9s - loss: 0.0984 - acc: 0.9672 - ETA: 9s - loss: 0.0981 - acc: 0.9676 - ETA: 9s - loss: 0.0975 - acc: 0.9677 - ETA: 9s - loss: 0.0980 - acc: 0.9679 - ETA: 9s - loss: 0.0974 - acc: 0.9682 - ETA: 9s - loss: 0.0966 - acc: 0.9685 - ETA: 9s - loss: 0.0955 - acc: 0.9686 - ETA: 9s - loss: 0.0957 - acc: 0.9684 - ETA: 8s - loss: 0.0948 - acc: 0.9690 - ETA: 8s - loss: 0.0946 - acc: 0.9693 - ETA: 8s - loss: 0.0966 - acc: 0.9681 - ETA: 8s - loss: 0.0978 - acc: 0.9679 - ETA: 8s - loss: 0.0977 - acc: 0.9680 - ETA: 8s - loss: 0.0982 - acc: 0.9681 - ETA: 8s - loss: 0.0997 - acc: 0.9674 - ETA: 8s - loss: 0.0993 - acc: 0.9675 - ETA: 8s - loss: 0.1000 - acc: 0.9669 - ETA: 8s - loss: 0.1003 - acc: 0.9664 - ETA: 8s - loss: 0.1014 - acc: 0.9661 - ETA: 8s - loss: 0.1011 - acc: 0.9659 - ETA: 8s - loss: 0.1009 - acc: 0.9660 - ETA: 7s - loss: 0.1019 - acc: 0.9661 - ETA: 7s - loss: 0.1023 - acc: 0.9656 - ETA: 7s - loss: 0.1030 - acc: 0.9650 - ETA: 7s - loss: 0.1021 - acc: 0.9655 - ETA: 7s - loss: 0.1027 - acc: 0.9654 - ETA: 7s - loss: 0.1025 - acc: 0.9652 - ETA: 7s - loss: 0.1032 - acc: 0.9653 - ETA: 7s - loss: 0.1025 - acc: 0.9655 - ETA: 7s - loss: 0.1036 - acc: 0.9650 - ETA: 7s - loss: 0.1039 - acc: 0.9649 - ETA: 7s - loss: 0.1055 - acc: 0.9640 - ETA: 7s - loss: 0.1062 - acc: 0.9639 - ETA: 7s - loss: 0.1060 - acc: 0.9638 - ETA: 7s - loss: 0.1058 - acc: 0.9636 - ETA: 7s - loss: 0.1055 - acc: 0.9639 - ETA: 7s - loss: 0.1063 - acc: 0.9638 - ETA: 7s - loss: 0.1080 - acc: 0.9633 - ETA: 7s - loss: 0.1071 - acc: 0.9638 - ETA: 7s - loss: 0.1074 - acc: 0.9637 - ETA: 7s - loss: 0.1072 - acc: 0.9640 - ETA: 6s - loss: 0.1084 - acc: 0.9638 - ETA: 6s - loss: 0.1091 - acc: 0.9634 - ETA: 6s - loss: 0.1101 - acc: 0.9632 - ETA: 6s - loss: 0.1100 - acc: 0.9631 - ETA: 6s - loss: 0.1105 - acc: 0.9633 - ETA: 6s - loss: 0.1096 - acc: 0.9637 - ETA: 6s - loss: 0.1101 - acc: 0.9639 - ETA: 6s - loss: 0.1100 - acc: 0.9640 - ETA: 6s - loss: 0.1105 - acc: 0.9636 - ETA: 6s - loss: 0.1118 - acc: 0.9629 - ETA: 6s - loss: 0.1113 - acc: 0.9630 - ETA: 6s - loss: 0.1109 - acc: 0.9634 - ETA: 6s - loss: 0.1100 - acc: 0.9638 - ETA: 6s - loss: 0.1100 - acc: 0.9640 - ETA: 6s - loss: 0.1109 - acc: 0.9637 - ETA: 5s - loss: 0.1112 - acc: 0.9635 - ETA: 5s - loss: 0.1112 - acc: 0.9635 - ETA: 5s - loss: 0.1107 - acc: 0.9636 - ETA: 5s - loss: 0.1109 - acc: 0.9635 - ETA: 5s - loss: 0.1104 - acc: 0.9636 - ETA: 5s - loss: 0.1098 - acc: 0.9640 - ETA: 5s - loss: 0.1097 - acc: 0.9639 - ETA: 5s - loss: 0.1101 - acc: 0.9638 - ETA: 5s - loss: 0.1115 - acc: 0.9637 - ETA: 5s - loss: 0.1117 - acc: 0.9637 - ETA: 5s - loss: 0.1112 - acc: 0.9638 - ETA: 5s - loss: 0.1104 - acc: 0.9642 - ETA: 5s - loss: 0.1107 - acc: 0.9643 - ETA: 5s - loss: 0.1106 - acc: 0.9642 - ETA: 5s - loss: 0.1109 - acc: 0.9641 - ETA: 5s - loss: 0.1109 - acc: 0.9640 - ETA: 4s - loss: 0.1116 - acc: 0.9641 - ETA: 4s - loss: 0.1121 - acc: 0.9642 - ETA: 4s - loss: 0.1121 - acc: 0.9639 - ETA: 4s - loss: 0.1117 - acc: 0.9640 - ETA: 4s - loss: 0.1121 - acc: 0.9637 - ETA: 4s - loss: 0.1129 - acc: 0.9636 - ETA: 4s - loss: 0.1136 - acc: 0.9634 - ETA: 4s - loss: 0.1132 - acc: 0.9635 - ETA: 4s - loss: 0.1132 - acc: 0.9635 - ETA: 4s - loss: 0.1130 - acc: 0.9636 - ETA: 4s - loss: 0.1129 - acc: 0.9637 - ETA: 4s - loss: 0.1140 - acc: 0.9636 - ETA: 4s - loss: 0.1138 - acc: 0.9637 - ETA: 4s - loss: 0.1137 - acc: 0.9639 - ETA: 4s - loss: 0.1140 - acc: 0.9636 - ETA: 4s - loss: 0.1140 - acc: 0.9635 - ETA: 3s - loss: 0.1152 - acc: 0.9634 - ETA: 3s - loss: 0.1157 - acc: 0.9631 - ETA: 3s - loss: 0.1154 - acc: 0.9632 - ETA: 3s - loss: 0.1160 - acc: 0.9631 - ETA: 3s - loss: 0.1160 - acc: 0.9630 - ETA: 3s - loss: 0.1165 - acc: 0.9627 - ETA: 3s - loss: 0.1164 - acc: 0.9628 - ETA: 3s - loss: 0.1165 - acc: 0.9628 - ETA: 3s - loss: 0.1171 - acc: 0.9624 - ETA: 3s - loss: 0.1169 - acc: 0.9626 - ETA: 3s - loss: 0.1166 - acc: 0.9627 - ETA: 3s - loss: 0.1169 - acc: 0.9624 - ETA: 3s - loss: 0.1175 - acc: 0.9619 - ETA: 3s - loss: 0.1175 - acc: 0.9619 - ETA: 3s - loss: 0.1185 - acc: 0.9618 - ETA: 2s - loss: 0.1185 - acc: 0.9617 - ETA: 2s - loss: 0.1181 - acc: 0.9616 - ETA: 2s - loss: 0.1178 - acc: 0.9619 - ETA: 2s - loss: 0.1183 - acc: 0.9615 - ETA: 2s - loss: 0.1187 - acc: 0.9614 - ETA: 2s - loss: 0.1185 - acc: 0.9613 - ETA: 2s - loss: 0.1183 - acc: 0.9615 - ETA: 2s - loss: 0.1180 - acc: 0.9616 - ETA: 2s - loss: 0.1177 - acc: 0.9617 - ETA: 2s - loss: 0.1182 - acc: 0.9617 - ETA: 2s - loss: 0.1178 - acc: 0.9618 - ETA: 2s - loss: 0.1173 - acc: 0.9621 - ETA: 2s - loss: 0.1170 - acc: 0.9622 - ETA: 2s - loss: 0.1168 - acc: 0.9624 - ETA: 2s - loss: 0.1167 - acc: 0.9623 - ETA: 2s - loss: 0.1166 - acc: 0.9624 - ETA: 2s - loss: 0.1163 - acc: 0.9625 - ETA: 1s - loss: 0.1161 - acc: 0.9626 - ETA: 1s - loss: 0.1176 - acc: 0.9621 - ETA: 1s - loss: 0.1175 - acc: 0.9623 - ETA: 1s - loss: 0.1171 - acc: 0.9624 - ETA: 1s - loss: 0.1173 - acc: 0.9622 - ETA: 1s - loss: 0.1191 - acc: 0.9619 - ETA: 1s - loss: 0.1194 - acc: 0.9619 - ETA: 1s - loss: 0.1192 - acc: 0.9619 - ETA: 1s - loss: 0.1193 - acc: 0.9619 - ETA: 1s - loss: 0.1190 - acc: 0.9620 - ETA: 1s - loss: 0.1201 - acc: 0.9618 - ETA: 1s - loss: 0.1196 - acc: 0.9621 - ETA: 1s - loss: 0.1196 - acc: 0.9620 - ETA: 1s - loss: 0.1194 - acc: 0.9621 - ETA: 1s - loss: 0.1192 - acc: 0.9623 - ETA: 1s - loss: 0.1187 - acc: 0.9625 - ETA: 1s - loss: 0.1195 - acc: 0.9621 - ETA: 1s - loss: 0.1198 - acc: 0.9621 - ETA: 0s - loss: 0.1196 - acc: 0.9622 - ETA: 0s - loss: 0.1200 - acc: 0.9618 - ETA: 0s - loss: 0.1202 - acc: 0.9617 - ETA: 0s - loss: 0.1203 - acc: 0.9615 - ETA: 0s - loss: 0.1200 - acc: 0.9616 - ETA: 0s - loss: 0.1196 - acc: 0.9619 - ETA: 0s - loss: 0.1208 - acc: 0.9618 - ETA: 0s - loss: 0.1212 - acc: 0.9616 - ETA: 0s - loss: 0.1216 - acc: 0.9615 - ETA: 0s - loss: 0.1215 - acc: 0.9615 - ETA: 0s - loss: 0.1228 - acc: 0.9611 - ETA: 0s - loss: 0.1228 - acc: 0.9612 - ETA: 0s - loss: 0.1226 - acc: 0.9612 - ETA: 0s - loss: 0.1224 - acc: 0.9611 - ETA: 0s - loss: 0.1228 - acc: 0.9606 - ETA: 0s - loss: 0.1237 - acc: 0.9602Epoch 00004: val_loss did not improve
6680/6680 [==============================] - 13s - loss: 0.1233 - acc: 0.9603 - val_loss: 0.6761 - val_acc: 0.8120
Epoch 6/20
6640/6680 [============================>.] - ETA: 9s - loss: 0.0248 - acc: 1.0000 - ETA: 9s - loss: 0.0168 - acc: 1.0000 - ETA: 11s - loss: 0.0392 - acc: 0.9875 - ETA: 12s - loss: 0.0357 - acc: 0.9900 - ETA: 12s - loss: 0.0363 - acc: 0.9857 - ETA: 11s - loss: 0.0338 - acc: 0.9889 - ETA: 11s - loss: 0.0375 - acc: 0.9900 - ETA: 12s - loss: 0.0348 - acc: 0.9909 - ETA: 11s - loss: 0.0324 - acc: 0.9923 - ETA: 12s - loss: 0.0309 - acc: 0.9929 - ETA: 11s - loss: 0.0460 - acc: 0.9875 - ETA: 11s - loss: 0.0508 - acc: 0.9861 - ETA: 11s - loss: 0.0502 - acc: 0.9868 - ETA: 11s - loss: 0.0527 - acc: 0.9875 - ETA: 11s - loss: 0.0608 - acc: 0.9841 - ETA: 11s - loss: 0.0674 - acc: 0.9792 - ETA: 11s - loss: 0.0703 - acc: 0.9769 - ETA: 11s - loss: 0.0685 - acc: 0.9778 - ETA: 11s - loss: 0.0694 - acc: 0.9776 - ETA: 11s - loss: 0.0740 - acc: 0.9742 - ETA: 11s - loss: 0.0779 - acc: 0.9712 - ETA: 11s - loss: 0.0776 - acc: 0.9706 - ETA: 11s - loss: 0.0794 - acc: 0.9694 - ETA: 10s - loss: 0.0792 - acc: 0.9697 - ETA: 10s - loss: 0.0802 - acc: 0.9692 - ETA: 10s - loss: 0.0784 - acc: 0.9707 - ETA: 10s - loss: 0.0780 - acc: 0.9714 - ETA: 10s - loss: 0.0806 - acc: 0.9705 - ETA: 10s - loss: 0.0814 - acc: 0.9696 - ETA: 10s - loss: 0.0804 - acc: 0.9702 - ETA: 10s - loss: 0.0794 - acc: 0.9714 - ETA: 10s - loss: 0.0789 - acc: 0.9716 - ETA: 10s - loss: 0.0823 - acc: 0.9702 - ETA: 10s - loss: 0.0814 - acc: 0.9708 - ETA: 10s - loss: 0.0805 - acc: 0.9709 - ETA: 10s - loss: 0.0792 - acc: 0.9714 - ETA: 10s - loss: 0.0779 - acc: 0.9724 - ETA: 10s - loss: 0.0759 - acc: 0.9733 - ETA: 10s - loss: 0.0749 - acc: 0.9738 - ETA: 9s - loss: 0.0751 - acc: 0.9738  - ETA: 9s - loss: 0.0803 - acc: 0.9715 - ETA: 9s - loss: 0.0816 - acc: 0.9712 - ETA: 9s - loss: 0.0797 - acc: 0.9721 - ETA: 9s - loss: 0.0784 - acc: 0.9729 - ETA: 9s - loss: 0.0776 - acc: 0.9732 - ETA: 9s - loss: 0.0781 - acc: 0.9733 - ETA: 9s - loss: 0.0788 - acc: 0.9733 - ETA: 9s - loss: 0.0780 - acc: 0.9737 - ETA: 9s - loss: 0.0769 - acc: 0.9744 - ETA: 9s - loss: 0.0767 - acc: 0.9747 - ETA: 9s - loss: 0.0768 - acc: 0.9741 - ETA: 9s - loss: 0.0797 - acc: 0.9741 - ETA: 9s - loss: 0.0789 - acc: 0.9741 - ETA: 9s - loss: 0.0781 - acc: 0.9744 - ETA: 9s - loss: 0.0778 - acc: 0.9744 - ETA: 9s - loss: 0.0770 - acc: 0.9747 - ETA: 8s - loss: 0.0759 - acc: 0.9753 - ETA: 8s - loss: 0.0755 - acc: 0.9755 - ETA: 8s - loss: 0.0746 - acc: 0.9761 - ETA: 8s - loss: 0.0745 - acc: 0.9763 - ETA: 8s - loss: 0.0737 - acc: 0.9768 - ETA: 8s - loss: 0.0732 - acc: 0.9768 - ETA: 8s - loss: 0.0729 - acc: 0.9767 - ETA: 8s - loss: 0.0723 - acc: 0.9772 - ETA: 8s - loss: 0.0746 - acc: 0.9767 - ETA: 8s - loss: 0.0752 - acc: 0.9762 - ETA: 8s - loss: 0.0747 - acc: 0.9764 - ETA: 8s - loss: 0.0744 - acc: 0.9764 - ETA: 8s - loss: 0.0744 - acc: 0.9768 - ETA: 8s - loss: 0.0734 - acc: 0.9772 - ETA: 7s - loss: 0.0733 - acc: 0.9772 - ETA: 7s - loss: 0.0733 - acc: 0.9774 - ETA: 7s - loss: 0.0728 - acc: 0.9775 - ETA: 7s - loss: 0.0742 - acc: 0.9775 - ETA: 7s - loss: 0.0735 - acc: 0.9775 - ETA: 7s - loss: 0.0736 - acc: 0.9772 - ETA: 7s - loss: 0.0741 - acc: 0.9770 - ETA: 7s - loss: 0.0745 - acc: 0.9770 - ETA: 7s - loss: 0.0742 - acc: 0.9772 - ETA: 7s - loss: 0.0738 - acc: 0.9773 - ETA: 7s - loss: 0.0734 - acc: 0.9775 - ETA: 7s - loss: 0.0738 - acc: 0.9769 - ETA: 7s - loss: 0.0743 - acc: 0.9765 - ETA: 7s - loss: 0.0743 - acc: 0.9769 - ETA: 7s - loss: 0.0739 - acc: 0.9772 - ETA: 7s - loss: 0.0736 - acc: 0.9774 - ETA: 7s - loss: 0.0735 - acc: 0.9775 - ETA: 7s - loss: 0.0748 - acc: 0.9768 - ETA: 7s - loss: 0.0749 - acc: 0.9766 - ETA: 7s - loss: 0.0745 - acc: 0.9768 - ETA: 7s - loss: 0.0747 - acc: 0.9762 - ETA: 7s - loss: 0.0754 - acc: 0.9760 - ETA: 7s - loss: 0.0756 - acc: 0.9757 - ETA: 6s - loss: 0.0751 - acc: 0.9760 - ETA: 6s - loss: 0.0753 - acc: 0.9760 - ETA: 6s - loss: 0.0752 - acc: 0.9762 - ETA: 6s - loss: 0.0749 - acc: 0.9765 - ETA: 6s - loss: 0.0745 - acc: 0.9768 - ETA: 6s - loss: 0.0750 - acc: 0.9766 - ETA: 6s - loss: 0.0754 - acc: 0.9766 - ETA: 6s - loss: 0.0759 - acc: 0.9762 - ETA: 6s - loss: 0.0772 - acc: 0.9761 - ETA: 6s - loss: 0.0785 - acc: 0.9755 - ETA: 6s - loss: 0.0783 - acc: 0.9758 - ETA: 6s - loss: 0.0782 - acc: 0.9754 - ETA: 6s - loss: 0.0784 - acc: 0.9754 - ETA: 6s - loss: 0.0795 - acc: 0.9749 - ETA: 6s - loss: 0.0791 - acc: 0.9750 - ETA: 5s - loss: 0.0796 - acc: 0.9750 - ETA: 5s - loss: 0.0790 - acc: 0.9753 - ETA: 5s - loss: 0.0793 - acc: 0.9751 - ETA: 5s - loss: 0.0788 - acc: 0.9754 - ETA: 5s - loss: 0.0785 - acc: 0.9754 - ETA: 5s - loss: 0.0784 - acc: 0.9753 - ETA: 5s - loss: 0.0788 - acc: 0.9749 - ETA: 5s - loss: 0.0784 - acc: 0.9751 - ETA: 5s - loss: 0.0778 - acc: 0.9754 - ETA: 5s - loss: 0.0780 - acc: 0.9751 - ETA: 5s - loss: 0.0779 - acc: 0.9750 - ETA: 5s - loss: 0.0777 - acc: 0.9751 - ETA: 5s - loss: 0.0780 - acc: 0.9749 - ETA: 5s - loss: 0.0777 - acc: 0.9750 - ETA: 5s - loss: 0.0773 - acc: 0.9750 - ETA: 5s - loss: 0.0773 - acc: 0.9750 - ETA: 4s - loss: 0.0767 - acc: 0.9752 - ETA: 4s - loss: 0.0771 - acc: 0.9751 - ETA: 4s - loss: 0.0772 - acc: 0.9752 - ETA: 4s - loss: 0.0772 - acc: 0.9755 - ETA: 4s - loss: 0.0769 - acc: 0.9756 - ETA: 4s - loss: 0.0769 - acc: 0.9756 - ETA: 4s - loss: 0.0768 - acc: 0.9758 - ETA: 4s - loss: 0.0769 - acc: 0.9757 - ETA: 4s - loss: 0.0766 - acc: 0.9757 - ETA: 4s - loss: 0.0769 - acc: 0.9756 - ETA: 4s - loss: 0.0764 - acc: 0.9758 - ETA: 4s - loss: 0.0761 - acc: 0.9759 - ETA: 4s - loss: 0.0757 - acc: 0.9761 - ETA: 4s - loss: 0.0767 - acc: 0.9759 - ETA: 4s - loss: 0.0764 - acc: 0.9760 - ETA: 4s - loss: 0.0763 - acc: 0.9761 - ETA: 4s - loss: 0.0762 - acc: 0.9760 - ETA: 4s - loss: 0.0761 - acc: 0.9761 - ETA: 4s - loss: 0.0756 - acc: 0.9763 - ETA: 3s - loss: 0.0764 - acc: 0.9759 - ETA: 3s - loss: 0.0764 - acc: 0.9759 - ETA: 3s - loss: 0.0775 - acc: 0.9755 - ETA: 3s - loss: 0.0783 - acc: 0.9751 - ETA: 3s - loss: 0.0786 - acc: 0.9749 - ETA: 3s - loss: 0.0802 - acc: 0.9743 - ETA: 3s - loss: 0.0798 - acc: 0.9745 - ETA: 3s - loss: 0.0796 - acc: 0.9746 - ETA: 3s - loss: 0.0794 - acc: 0.9747 - ETA: 3s - loss: 0.0793 - acc: 0.9747 - ETA: 3s - loss: 0.0792 - acc: 0.9747 - ETA: 3s - loss: 0.0793 - acc: 0.9746 - ETA: 3s - loss: 0.0794 - acc: 0.9745 - ETA: 3s - loss: 0.0801 - acc: 0.9738 - ETA: 3s - loss: 0.0800 - acc: 0.9739 - ETA: 3s - loss: 0.0796 - acc: 0.9741 - ETA: 3s - loss: 0.0797 - acc: 0.9740 - ETA: 3s - loss: 0.0796 - acc: 0.9741 - ETA: 3s - loss: 0.0795 - acc: 0.9742 - ETA: 2s - loss: 0.0796 - acc: 0.9740 - ETA: 2s - loss: 0.0805 - acc: 0.9737 - ETA: 2s - loss: 0.0804 - acc: 0.9738 - ETA: 2s - loss: 0.0800 - acc: 0.9740 - ETA: 2s - loss: 0.0799 - acc: 0.9740 - ETA: 2s - loss: 0.0802 - acc: 0.9741 - ETA: 2s - loss: 0.0800 - acc: 0.9742 - ETA: 2s - loss: 0.0796 - acc: 0.9743 - ETA: 2s - loss: 0.0792 - acc: 0.9745 - ETA: 2s - loss: 0.0790 - acc: 0.9746 - ETA: 2s - loss: 0.0789 - acc: 0.9747 - ETA: 2s - loss: 0.0793 - acc: 0.9742 - ETA: 2s - loss: 0.0801 - acc: 0.9741 - ETA: 2s - loss: 0.0801 - acc: 0.9740 - ETA: 2s - loss: 0.0804 - acc: 0.9740 - ETA: 2s - loss: 0.0809 - acc: 0.9737 - ETA: 2s - loss: 0.0817 - acc: 0.9736 - ETA: 2s - loss: 0.0823 - acc: 0.9733 - ETA: 1s - loss: 0.0821 - acc: 0.9734 - ETA: 1s - loss: 0.0817 - acc: 0.9736 - ETA: 1s - loss: 0.0815 - acc: 0.9737 - ETA: 1s - loss: 0.0810 - acc: 0.9739 - ETA: 1s - loss: 0.0810 - acc: 0.9740 - ETA: 1s - loss: 0.0812 - acc: 0.9737 - ETA: 1s - loss: 0.0807 - acc: 0.9739 - ETA: 1s - loss: 0.0807 - acc: 0.9741 - ETA: 1s - loss: 0.0820 - acc: 0.9739 - ETA: 1s - loss: 0.0818 - acc: 0.9739 - ETA: 1s - loss: 0.0824 - acc: 0.9739 - ETA: 1s - loss: 0.0820 - acc: 0.9741 - ETA: 1s - loss: 0.0822 - acc: 0.9740 - ETA: 1s - loss: 0.0823 - acc: 0.9739 - ETA: 1s - loss: 0.0823 - acc: 0.9739 - ETA: 1s - loss: 0.0823 - acc: 0.9739 - ETA: 0s - loss: 0.0824 - acc: 0.9737 - ETA: 0s - loss: 0.0826 - acc: 0.9735 - ETA: 0s - loss: 0.0825 - acc: 0.9736 - ETA: 0s - loss: 0.0823 - acc: 0.9737 - ETA: 0s - loss: 0.0823 - acc: 0.9736 - ETA: 0s - loss: 0.0821 - acc: 0.9738 - ETA: 0s - loss: 0.0818 - acc: 0.9740 - ETA: 0s - loss: 0.0817 - acc: 0.9740 - ETA: 0s - loss: 0.0818 - acc: 0.9741 - ETA: 0s - loss: 0.0816 - acc: 0.9741 - ETA: 0s - loss: 0.0822 - acc: 0.9740 - ETA: 0s - loss: 0.0828 - acc: 0.9740 - ETA: 0s - loss: 0.0826 - acc: 0.9741 - ETA: 0s - loss: 0.0832 - acc: 0.9740 - ETA: 0s - loss: 0.0832 - acc: 0.9740 - ETA: 0s - loss: 0.0835 - acc: 0.9739 - ETA: 0s - loss: 0.0838 - acc: 0.9736Epoch 00005: val_loss did not improve
6680/6680 [==============================] - 12s - loss: 0.0849 - acc: 0.9732 - val_loss: 0.6835 - val_acc: 0.8060
Epoch 7/20
6660/6680 [============================>.] - ETA: 9s - loss: 0.0993 - acc: 0.9500 - ETA: 9s - loss: 0.0780 - acc: 0.9667 - ETA: 10s - loss: 0.0789 - acc: 0.9700 - ETA: 11s - loss: 0.0693 - acc: 0.9750 - ETA: 12s - loss: 0.0612 - acc: 0.9786 - ETA: 12s - loss: 0.0582 - acc: 0.9812 - ETA: 13s - loss: 0.0653 - acc: 0.9778 - ETA: 13s - loss: 0.0643 - acc: 0.9800 - ETA: 12s - loss: 0.0609 - acc: 0.9792 - ETA: 12s - loss: 0.0553 - acc: 0.9821 - ETA: 12s - loss: 0.0540 - acc: 0.9833 - ETA: 12s - loss: 0.0514 - acc: 0.9844 - ETA: 12s - loss: 0.0485 - acc: 0.9861 - ETA: 12s - loss: 0.0449 - acc: 0.9875 - ETA: 12s - loss: 0.0466 - acc: 0.9857 - ETA: 11s - loss: 0.0524 - acc: 0.9848 - ETA: 12s - loss: 0.0525 - acc: 0.9833 - ETA: 11s - loss: 0.0549 - acc: 0.9827 - ETA: 11s - loss: 0.0534 - acc: 0.9833 - ETA: 12s - loss: 0.0523 - acc: 0.9839 - ETA: 11s - loss: 0.0497 - acc: 0.9850 - ETA: 11s - loss: 0.0497 - acc: 0.9855 - ETA: 11s - loss: 0.0486 - acc: 0.9859 - ETA: 11s - loss: 0.0508 - acc: 0.9838 - ETA: 11s - loss: 0.0502 - acc: 0.9843 - ETA: 11s - loss: 0.0490 - acc: 0.9851 - ETA: 11s - loss: 0.0530 - acc: 0.9846 - ETA: 11s - loss: 0.0522 - acc: 0.9850 - ETA: 11s - loss: 0.0523 - acc: 0.9854 - ETA: 11s - loss: 0.0535 - acc: 0.9837 - ETA: 11s - loss: 0.0517 - acc: 0.9844 - ETA: 10s - loss: 0.0518 - acc: 0.9840 - ETA: 11s - loss: 0.0512 - acc: 0.9844 - ETA: 11s - loss: 0.0508 - acc: 0.9847 - ETA: 10s - loss: 0.0552 - acc: 0.9843 - ETA: 10s - loss: 0.0560 - acc: 0.9837 - ETA: 10s - loss: 0.0562 - acc: 0.9833 - ETA: 10s - loss: 0.0570 - acc: 0.9827 - ETA: 10s - loss: 0.0583 - acc: 0.9825 - ETA: 10s - loss: 0.0595 - acc: 0.9822 - ETA: 10s - loss: 0.0595 - acc: 0.9817 - ETA: 10s - loss: 0.0588 - acc: 0.9820 - ETA: 10s - loss: 0.0580 - acc: 0.9823 - ETA: 10s - loss: 0.0582 - acc: 0.9825 - ETA: 10s - loss: 0.0592 - acc: 0.9820 - ETA: 10s - loss: 0.0589 - acc: 0.9818 - ETA: 10s - loss: 0.0581 - acc: 0.9824 - ETA: 10s - loss: 0.0574 - acc: 0.9826 - ETA: 10s - loss: 0.0580 - acc: 0.9824 - ETA: 10s - loss: 0.0611 - acc: 0.9822 - ETA: 10s - loss: 0.0604 - acc: 0.9824 - ETA: 10s - loss: 0.0599 - acc: 0.9829 - ETA: 9s - loss: 0.0619 - acc: 0.9821  - ETA: 9s - loss: 0.0613 - acc: 0.9825 - ETA: 9s - loss: 0.0644 - acc: 0.9817 - ETA: 9s - loss: 0.0633 - acc: 0.9821 - ETA: 9s - loss: 0.0626 - acc: 0.9824 - ETA: 9s - loss: 0.0623 - acc: 0.9828 - ETA: 9s - loss: 0.0619 - acc: 0.9831 - ETA: 9s - loss: 0.0617 - acc: 0.9833 - ETA: 9s - loss: 0.0612 - acc: 0.9837 - ETA: 9s - loss: 0.0603 - acc: 0.9840 - ETA: 9s - loss: 0.0603 - acc: 0.9842 - ETA: 9s - loss: 0.0610 - acc: 0.9835 - ETA: 9s - loss: 0.0611 - acc: 0.9837 - ETA: 8s - loss: 0.0601 - acc: 0.9840 - ETA: 8s - loss: 0.0596 - acc: 0.9842 - ETA: 8s - loss: 0.0595 - acc: 0.9845 - ETA: 8s - loss: 0.0591 - acc: 0.9846 - ETA: 8s - loss: 0.0586 - acc: 0.9844 - ETA: 8s - loss: 0.0581 - acc: 0.9846 - ETA: 8s - loss: 0.0577 - acc: 0.9844 - ETA: 8s - loss: 0.0577 - acc: 0.9842 - ETA: 8s - loss: 0.0573 - acc: 0.9844 - ETA: 8s - loss: 0.0576 - acc: 0.9842 - ETA: 8s - loss: 0.0572 - acc: 0.9845 - ETA: 8s - loss: 0.0582 - acc: 0.9838 - ETA: 8s - loss: 0.0576 - acc: 0.9840 - ETA: 8s - loss: 0.0573 - acc: 0.9842 - ETA: 8s - loss: 0.0579 - acc: 0.9839 - ETA: 8s - loss: 0.0581 - acc: 0.9837 - ETA: 7s - loss: 0.0576 - acc: 0.9840 - ETA: 7s - loss: 0.0585 - acc: 0.9839 - ETA: 7s - loss: 0.0585 - acc: 0.9840 - ETA: 7s - loss: 0.0587 - acc: 0.9838 - ETA: 7s - loss: 0.0587 - acc: 0.9840 - ETA: 7s - loss: 0.0582 - acc: 0.9838 - ETA: 7s - loss: 0.0582 - acc: 0.9837 - ETA: 7s - loss: 0.0582 - acc: 0.9836 - ETA: 7s - loss: 0.0576 - acc: 0.9838 - ETA: 7s - loss: 0.0571 - acc: 0.9840 - ETA: 7s - loss: 0.0565 - acc: 0.9843 - ETA: 7s - loss: 0.0563 - acc: 0.9844 - ETA: 7s - loss: 0.0561 - acc: 0.9842 - ETA: 7s - loss: 0.0559 - acc: 0.9844 - ETA: 6s - loss: 0.0579 - acc: 0.9839 - ETA: 6s - loss: 0.0583 - acc: 0.9838 - ETA: 6s - loss: 0.0580 - acc: 0.9840 - ETA: 6s - loss: 0.0581 - acc: 0.9841 - ETA: 6s - loss: 0.0575 - acc: 0.9843 - ETA: 6s - loss: 0.0573 - acc: 0.9844 - ETA: 6s - loss: 0.0571 - acc: 0.9845 - ETA: 6s - loss: 0.0568 - acc: 0.9846 - ETA: 6s - loss: 0.0565 - acc: 0.9845 - ETA: 6s - loss: 0.0562 - acc: 0.9844 - ETA: 6s - loss: 0.0559 - acc: 0.9845 - ETA: 6s - loss: 0.0555 - acc: 0.9847 - ETA: 6s - loss: 0.0554 - acc: 0.9849 - ETA: 6s - loss: 0.0553 - acc: 0.9851 - ETA: 6s - loss: 0.0550 - acc: 0.9852 - ETA: 6s - loss: 0.0548 - acc: 0.9853 - ETA: 6s - loss: 0.0549 - acc: 0.9854 - ETA: 5s - loss: 0.0545 - acc: 0.9856 - ETA: 5s - loss: 0.0546 - acc: 0.9854 - ETA: 5s - loss: 0.0545 - acc: 0.9856 - ETA: 5s - loss: 0.0545 - acc: 0.9854 - ETA: 5s - loss: 0.0544 - acc: 0.9854 - ETA: 5s - loss: 0.0541 - acc: 0.9856 - ETA: 5s - loss: 0.0545 - acc: 0.9852 - ETA: 5s - loss: 0.0543 - acc: 0.9854 - ETA: 5s - loss: 0.0544 - acc: 0.9853 - ETA: 5s - loss: 0.0542 - acc: 0.9853 - ETA: 5s - loss: 0.0545 - acc: 0.9852 - ETA: 5s - loss: 0.0578 - acc: 0.9849 - ETA: 5s - loss: 0.0583 - acc: 0.9845 - ETA: 5s - loss: 0.0584 - acc: 0.9844 - ETA: 5s - loss: 0.0587 - acc: 0.9842 - ETA: 4s - loss: 0.0592 - acc: 0.9839 - ETA: 4s - loss: 0.0592 - acc: 0.9838 - ETA: 4s - loss: 0.0588 - acc: 0.9840 - ETA: 4s - loss: 0.0587 - acc: 0.9841 - ETA: 4s - loss: 0.0587 - acc: 0.9840 - ETA: 4s - loss: 0.0585 - acc: 0.9840 - ETA: 4s - loss: 0.0592 - acc: 0.9834 - ETA: 4s - loss: 0.0598 - acc: 0.9826 - ETA: 4s - loss: 0.0599 - acc: 0.9826 - ETA: 4s - loss: 0.0603 - acc: 0.9825 - ETA: 4s - loss: 0.0599 - acc: 0.9826 - ETA: 4s - loss: 0.0596 - acc: 0.9827 - ETA: 4s - loss: 0.0594 - acc: 0.9829 - ETA: 4s - loss: 0.0598 - acc: 0.9828 - ETA: 4s - loss: 0.0597 - acc: 0.9829 - ETA: 4s - loss: 0.0595 - acc: 0.9830 - ETA: 4s - loss: 0.0594 - acc: 0.9830 - ETA: 3s - loss: 0.0596 - acc: 0.9830 - ETA: 3s - loss: 0.0598 - acc: 0.9828 - ETA: 3s - loss: 0.0599 - acc: 0.9828 - ETA: 3s - loss: 0.0603 - acc: 0.9827 - ETA: 3s - loss: 0.0606 - acc: 0.9826 - ETA: 3s - loss: 0.0606 - acc: 0.9828 - ETA: 3s - loss: 0.0607 - acc: 0.9828 - ETA: 3s - loss: 0.0605 - acc: 0.9828 - ETA: 3s - loss: 0.0605 - acc: 0.9826 - ETA: 3s - loss: 0.0604 - acc: 0.9828 - ETA: 3s - loss: 0.0603 - acc: 0.9829 - ETA: 3s - loss: 0.0606 - acc: 0.9829 - ETA: 3s - loss: 0.0602 - acc: 0.9831 - ETA: 3s - loss: 0.0600 - acc: 0.9831 - ETA: 3s - loss: 0.0597 - acc: 0.9833 - ETA: 3s - loss: 0.0598 - acc: 0.9831 - ETA: 3s - loss: 0.0597 - acc: 0.9832 - ETA: 3s - loss: 0.0596 - acc: 0.9833 - ETA: 2s - loss: 0.0595 - acc: 0.9833 - ETA: 2s - loss: 0.0594 - acc: 0.9834 - ETA: 2s - loss: 0.0599 - acc: 0.9831 - ETA: 2s - loss: 0.0597 - acc: 0.9831 - ETA: 2s - loss: 0.0596 - acc: 0.9832 - ETA: 2s - loss: 0.0599 - acc: 0.9829 - ETA: 2s - loss: 0.0604 - acc: 0.9828 - ETA: 2s - loss: 0.0603 - acc: 0.9828 - ETA: 2s - loss: 0.0602 - acc: 0.9829 - ETA: 2s - loss: 0.0600 - acc: 0.9830 - ETA: 2s - loss: 0.0598 - acc: 0.9830 - ETA: 2s - loss: 0.0599 - acc: 0.9830 - ETA: 2s - loss: 0.0604 - acc: 0.9826 - ETA: 2s - loss: 0.0602 - acc: 0.9827 - ETA: 2s - loss: 0.0604 - acc: 0.9826 - ETA: 2s - loss: 0.0604 - acc: 0.9827 - ETA: 2s - loss: 0.0602 - acc: 0.9827 - ETA: 2s - loss: 0.0603 - acc: 0.9828 - ETA: 2s - loss: 0.0601 - acc: 0.9828 - ETA: 2s - loss: 0.0599 - acc: 0.9829 - ETA: 2s - loss: 0.0599 - acc: 0.9829 - ETA: 2s - loss: 0.0603 - acc: 0.9828 - ETA: 2s - loss: 0.0609 - acc: 0.9827 - ETA: 2s - loss: 0.0608 - acc: 0.9827 - ETA: 2s - loss: 0.0609 - acc: 0.9826 - ETA: 1s - loss: 0.0608 - acc: 0.9827 - ETA: 1s - loss: 0.0607 - acc: 0.9828 - ETA: 1s - loss: 0.0606 - acc: 0.9829 - ETA: 1s - loss: 0.0604 - acc: 0.9829 - ETA: 1s - loss: 0.0603 - acc: 0.9830 - ETA: 1s - loss: 0.0602 - acc: 0.9830 - ETA: 1s - loss: 0.0605 - acc: 0.9829 - ETA: 1s - loss: 0.0604 - acc: 0.9830 - ETA: 1s - loss: 0.0602 - acc: 0.9830 - ETA: 1s - loss: 0.0601 - acc: 0.9831 - ETA: 1s - loss: 0.0600 - acc: 0.9832 - ETA: 1s - loss: 0.0602 - acc: 0.9831 - ETA: 1s - loss: 0.0602 - acc: 0.9829 - ETA: 1s - loss: 0.0602 - acc: 0.9829 - ETA: 1s - loss: 0.0600 - acc: 0.9829 - ETA: 1s - loss: 0.0601 - acc: 0.9828 - ETA: 1s - loss: 0.0600 - acc: 0.9829 - ETA: 1s - loss: 0.0598 - acc: 0.9829 - ETA: 1s - loss: 0.0599 - acc: 0.9827 - ETA: 1s - loss: 0.0596 - acc: 0.9828 - ETA: 1s - loss: 0.0594 - acc: 0.9830 - ETA: 0s - loss: 0.0594 - acc: 0.9828 - ETA: 0s - loss: 0.0594 - acc: 0.9828 - ETA: 0s - loss: 0.0596 - acc: 0.9827 - ETA: 0s - loss: 0.0602 - acc: 0.9825 - ETA: 0s - loss: 0.0601 - acc: 0.9825 - ETA: 0s - loss: 0.0608 - acc: 0.9822 - ETA: 0s - loss: 0.0608 - acc: 0.9821 - ETA: 0s - loss: 0.0607 - acc: 0.9821 - ETA: 0s - loss: 0.0605 - acc: 0.9822 - ETA: 0s - loss: 0.0609 - acc: 0.9820 - ETA: 0s - loss: 0.0609 - acc: 0.9820 - ETA: 0s - loss: 0.0610 - acc: 0.9819 - ETA: 0s - loss: 0.0619 - acc: 0.9816 - ETA: 0s - loss: 0.0620 - acc: 0.9815Epoch 00006: val_loss did not improve
6680/6680 [==============================] - 13s - loss: 0.0621 - acc: 0.9813 - val_loss: 0.6770 - val_acc: 0.8251
Epoch 8/20
6660/6680 [============================>.] - ETA: 6s - loss: 0.0238 - acc: 1.0000 - ETA: 11s - loss: 0.0163 - acc: 1.0000 - ETA: 11s - loss: 0.0173 - acc: 1.0000 - ETA: 11s - loss: 0.0169 - acc: 1.0000 - ETA: 11s - loss: 0.0230 - acc: 0.9937 - ETA: 11s - loss: 0.0214 - acc: 0.9944 - ETA: 11s - loss: 0.0202 - acc: 0.9950 - ETA: 12s - loss: 0.0190 - acc: 0.9955 - ETA: 12s - loss: 0.0238 - acc: 0.9962 - ETA: 12s - loss: 0.0237 - acc: 0.9964 - ETA: 12s - loss: 0.0357 - acc: 0.9933 - ETA: 12s - loss: 0.0448 - acc: 0.9875 - ETA: 13s - loss: 0.0425 - acc: 0.9882 - ETA: 12s - loss: 0.0402 - acc: 0.9895 - ETA: 12s - loss: 0.0386 - acc: 0.9905 - ETA: 12s - loss: 0.0373 - acc: 0.9913 - ETA: 12s - loss: 0.0365 - acc: 0.9917 - ETA: 12s - loss: 0.0360 - acc: 0.9904 - ETA: 12s - loss: 0.0347 - acc: 0.9911 - ETA: 12s - loss: 0.0351 - acc: 0.9914 - ETA: 11s - loss: 0.0355 - acc: 0.9919 - ETA: 11s - loss: 0.0369 - acc: 0.9894 - ETA: 11s - loss: 0.0359 - acc: 0.9897 - ETA: 11s - loss: 0.0353 - acc: 0.9900 - ETA: 11s - loss: 0.0345 - acc: 0.9903 - ETA: 11s - loss: 0.0339 - acc: 0.9908 - ETA: 11s - loss: 0.0327 - acc: 0.9912 - ETA: 11s - loss: 0.0324 - acc: 0.9915 - ETA: 11s - loss: 0.0319 - acc: 0.9917 - ETA: 11s - loss: 0.0322 - acc: 0.9920 - ETA: 11s - loss: 0.0317 - acc: 0.9922 - ETA: 11s - loss: 0.0316 - acc: 0.9926 - ETA: 11s - loss: 0.0316 - acc: 0.9927 - ETA: 11s - loss: 0.0315 - acc: 0.9929 - ETA: 11s - loss: 0.0306 - acc: 0.9931 - ETA: 11s - loss: 0.0302 - acc: 0.9933 - ETA: 11s - loss: 0.0300 - acc: 0.9934 - ETA: 11s - loss: 0.0296 - acc: 0.9935 - ETA: 11s - loss: 0.0299 - acc: 0.9927 - ETA: 11s - loss: 0.0307 - acc: 0.9921 - ETA: 11s - loss: 0.0304 - acc: 0.9924 - ETA: 11s - loss: 0.0301 - acc: 0.9925 - ETA: 10s - loss: 0.0298 - acc: 0.9927 - ETA: 10s - loss: 0.0329 - acc: 0.9922 - ETA: 10s - loss: 0.0327 - acc: 0.9924 - ETA: 10s - loss: 0.0338 - acc: 0.9919 - ETA: 10s - loss: 0.0335 - acc: 0.9920 - ETA: 10s - loss: 0.0332 - acc: 0.9921 - ETA: 10s - loss: 0.0329 - acc: 0.9923 - ETA: 10s - loss: 0.0328 - acc: 0.9924 - ETA: 10s - loss: 0.0332 - acc: 0.9925 - ETA: 10s - loss: 0.0333 - acc: 0.9926 - ETA: 10s - loss: 0.0330 - acc: 0.9927 - ETA: 10s - loss: 0.0330 - acc: 0.9928 - ETA: 10s - loss: 0.0343 - acc: 0.9923 - ETA: 10s - loss: 0.0342 - acc: 0.9924 - ETA: 10s - loss: 0.0340 - acc: 0.9925 - ETA: 10s - loss: 0.0347 - acc: 0.9921 - ETA: 10s - loss: 0.0344 - acc: 0.9923 - ETA: 10s - loss: 0.0341 - acc: 0.9924 - ETA: 10s - loss: 0.0336 - acc: 0.9925 - ETA: 9s - loss: 0.0335 - acc: 0.9926  - ETA: 9s - loss: 0.0331 - acc: 0.9927 - ETA: 9s - loss: 0.0329 - acc: 0.9928 - ETA: 9s - loss: 0.0323 - acc: 0.9929 - ETA: 9s - loss: 0.0320 - acc: 0.9930 - ETA: 9s - loss: 0.0319 - acc: 0.9932 - ETA: 9s - loss: 0.0318 - acc: 0.9932 - ETA: 9s - loss: 0.0314 - acc: 0.9934 - ETA: 9s - loss: 0.0314 - acc: 0.9935 - ETA: 9s - loss: 0.0313 - acc: 0.9936 - ETA: 9s - loss: 0.0316 - acc: 0.9936 - ETA: 9s - loss: 0.0316 - acc: 0.9937 - ETA: 9s - loss: 0.0336 - acc: 0.9929 - ETA: 9s - loss: 0.0335 - acc: 0.9930 - ETA: 9s - loss: 0.0333 - acc: 0.9931 - ETA: 9s - loss: 0.0332 - acc: 0.9931 - ETA: 9s - loss: 0.0328 - acc: 0.9932 - ETA: 8s - loss: 0.0323 - acc: 0.9934 - ETA: 8s - loss: 0.0330 - acc: 0.9930 - ETA: 8s - loss: 0.0334 - acc: 0.9923 - ETA: 8s - loss: 0.0332 - acc: 0.9924 - ETA: 8s - loss: 0.0330 - acc: 0.9924 - ETA: 8s - loss: 0.0328 - acc: 0.9925 - ETA: 8s - loss: 0.0327 - acc: 0.9926 - ETA: 8s - loss: 0.0325 - acc: 0.9926 - ETA: 8s - loss: 0.0324 - acc: 0.9927 - ETA: 8s - loss: 0.0344 - acc: 0.9924 - ETA: 8s - loss: 0.0348 - acc: 0.9921 - ETA: 8s - loss: 0.0347 - acc: 0.9922 - ETA: 8s - loss: 0.0346 - acc: 0.9924 - ETA: 8s - loss: 0.0342 - acc: 0.9925 - ETA: 7s - loss: 0.0345 - acc: 0.9922 - ETA: 7s - loss: 0.0344 - acc: 0.9923 - ETA: 7s - loss: 0.0345 - acc: 0.9923 - ETA: 7s - loss: 0.0345 - acc: 0.9924 - ETA: 7s - loss: 0.0343 - acc: 0.9924 - ETA: 7s - loss: 0.0352 - acc: 0.9921 - ETA: 7s - loss: 0.0350 - acc: 0.9922 - ETA: 7s - loss: 0.0348 - acc: 0.9923 - ETA: 7s - loss: 0.0346 - acc: 0.9923 - ETA: 7s - loss: 0.0367 - acc: 0.9921 - ETA: 7s - loss: 0.0365 - acc: 0.9921 - ETA: 7s - loss: 0.0363 - acc: 0.9922 - ETA: 7s - loss: 0.0366 - acc: 0.9919 - ETA: 7s - loss: 0.0366 - acc: 0.9919 - ETA: 7s - loss: 0.0366 - acc: 0.9920 - ETA: 7s - loss: 0.0364 - acc: 0.9921 - ETA: 7s - loss: 0.0363 - acc: 0.9921 - ETA: 7s - loss: 0.0369 - acc: 0.9918 - ETA: 7s - loss: 0.0369 - acc: 0.9919 - ETA: 7s - loss: 0.0367 - acc: 0.9920 - ETA: 7s - loss: 0.0369 - acc: 0.9917 - ETA: 7s - loss: 0.0368 - acc: 0.9918 - ETA: 7s - loss: 0.0375 - acc: 0.9916 - ETA: 7s - loss: 0.0381 - acc: 0.9913 - ETA: 7s - loss: 0.0381 - acc: 0.9914 - ETA: 7s - loss: 0.0381 - acc: 0.9914 - ETA: 7s - loss: 0.0379 - acc: 0.9915 - ETA: 6s - loss: 0.0380 - acc: 0.9915 - ETA: 6s - loss: 0.0379 - acc: 0.9916 - ETA: 6s - loss: 0.0379 - acc: 0.9917 - ETA: 6s - loss: 0.0401 - acc: 0.9908 - ETA: 6s - loss: 0.0405 - acc: 0.9906 - ETA: 6s - loss: 0.0403 - acc: 0.9906 - ETA: 6s - loss: 0.0406 - acc: 0.9905 - ETA: 6s - loss: 0.0405 - acc: 0.9905 - ETA: 6s - loss: 0.0404 - acc: 0.9906 - ETA: 6s - loss: 0.0403 - acc: 0.9906 - ETA: 6s - loss: 0.0401 - acc: 0.9907 - ETA: 6s - loss: 0.0400 - acc: 0.9907 - ETA: 6s - loss: 0.0397 - acc: 0.9908 - ETA: 6s - loss: 0.0397 - acc: 0.9909 - ETA: 6s - loss: 0.0396 - acc: 0.9909 - ETA: 6s - loss: 0.0397 - acc: 0.9908 - ETA: 6s - loss: 0.0397 - acc: 0.9908 - ETA: 6s - loss: 0.0395 - acc: 0.9909 - ETA: 6s - loss: 0.0393 - acc: 0.9909 - ETA: 6s - loss: 0.0394 - acc: 0.9907 - ETA: 6s - loss: 0.0403 - acc: 0.9905 - ETA: 5s - loss: 0.0403 - acc: 0.9903 - ETA: 5s - loss: 0.0401 - acc: 0.9904 - ETA: 5s - loss: 0.0400 - acc: 0.9904 - ETA: 5s - loss: 0.0400 - acc: 0.9903 - ETA: 5s - loss: 0.0407 - acc: 0.9898 - ETA: 5s - loss: 0.0408 - acc: 0.9896 - ETA: 5s - loss: 0.0407 - acc: 0.9896 - ETA: 5s - loss: 0.0405 - acc: 0.9897 - ETA: 5s - loss: 0.0406 - acc: 0.9895 - ETA: 5s - loss: 0.0405 - acc: 0.9896 - ETA: 5s - loss: 0.0402 - acc: 0.9897 - ETA: 5s - loss: 0.0403 - acc: 0.9895 - ETA: 5s - loss: 0.0404 - acc: 0.9895 - ETA: 5s - loss: 0.0404 - acc: 0.9896 - ETA: 5s - loss: 0.0402 - acc: 0.9896 - ETA: 5s - loss: 0.0400 - acc: 0.9897 - ETA: 5s - loss: 0.0399 - acc: 0.9897 - ETA: 5s - loss: 0.0397 - acc: 0.9898 - ETA: 5s - loss: 0.0398 - acc: 0.9898 - ETA: 5s - loss: 0.0397 - acc: 0.9899 - ETA: 5s - loss: 0.0397 - acc: 0.9899 - ETA: 5s - loss: 0.0396 - acc: 0.9900 - ETA: 5s - loss: 0.0395 - acc: 0.9900 - ETA: 5s - loss: 0.0395 - acc: 0.9898 - ETA: 4s - loss: 0.0398 - acc: 0.9896 - ETA: 4s - loss: 0.0397 - acc: 0.9897 - ETA: 4s - loss: 0.0397 - acc: 0.9897 - ETA: 4s - loss: 0.0395 - acc: 0.9898 - ETA: 4s - loss: 0.0394 - acc: 0.9898 - ETA: 4s - loss: 0.0395 - acc: 0.9899 - ETA: 4s - loss: 0.0393 - acc: 0.9899 - ETA: 4s - loss: 0.0397 - acc: 0.9897 - ETA: 4s - loss: 0.0397 - acc: 0.9898 - ETA: 4s - loss: 0.0396 - acc: 0.9898 - ETA: 4s - loss: 0.0398 - acc: 0.9896 - ETA: 4s - loss: 0.0396 - acc: 0.9897 - ETA: 4s - loss: 0.0404 - acc: 0.9895 - ETA: 4s - loss: 0.0403 - acc: 0.9896 - ETA: 4s - loss: 0.0404 - acc: 0.9896 - ETA: 4s - loss: 0.0404 - acc: 0.9897 - ETA: 4s - loss: 0.0402 - acc: 0.9897 - ETA: 4s - loss: 0.0403 - acc: 0.9895 - ETA: 4s - loss: 0.0402 - acc: 0.9896 - ETA: 4s - loss: 0.0402 - acc: 0.9896 - ETA: 4s - loss: 0.0403 - acc: 0.9895 - ETA: 4s - loss: 0.0401 - acc: 0.9895 - ETA: 4s - loss: 0.0400 - acc: 0.9895 - ETA: 4s - loss: 0.0400 - acc: 0.9896 - ETA: 4s - loss: 0.0400 - acc: 0.9896 - ETA: 4s - loss: 0.0402 - acc: 0.9895 - ETA: 3s - loss: 0.0402 - acc: 0.9895 - ETA: 3s - loss: 0.0399 - acc: 0.9896 - ETA: 3s - loss: 0.0399 - acc: 0.9896 - ETA: 3s - loss: 0.0400 - acc: 0.9895 - ETA: 3s - loss: 0.0405 - acc: 0.9893 - ETA: 3s - loss: 0.0403 - acc: 0.9894 - ETA: 3s - loss: 0.0402 - acc: 0.9894 - ETA: 3s - loss: 0.0406 - acc: 0.9893 - ETA: 3s - loss: 0.0404 - acc: 0.9894 - ETA: 3s - loss: 0.0404 - acc: 0.9895 - ETA: 3s - loss: 0.0402 - acc: 0.9896 - ETA: 3s - loss: 0.0401 - acc: 0.9896 - ETA: 3s - loss: 0.0403 - acc: 0.9897 - ETA: 3s - loss: 0.0404 - acc: 0.9896 - ETA: 2s - loss: 0.0403 - acc: 0.9897 - ETA: 2s - loss: 0.0401 - acc: 0.9897 - ETA: 2s - loss: 0.0403 - acc: 0.9894 - ETA: 2s - loss: 0.0407 - acc: 0.9893 - ETA: 2s - loss: 0.0409 - acc: 0.9892 - ETA: 2s - loss: 0.0410 - acc: 0.9892 - ETA: 2s - loss: 0.0410 - acc: 0.9893 - ETA: 2s - loss: 0.0409 - acc: 0.9893 - ETA: 2s - loss: 0.0408 - acc: 0.9894 - ETA: 2s - loss: 0.0409 - acc: 0.9895 - ETA: 2s - loss: 0.0409 - acc: 0.9895 - ETA: 2s - loss: 0.0408 - acc: 0.9895 - ETA: 2s - loss: 0.0410 - acc: 0.9892 - ETA: 2s - loss: 0.0416 - acc: 0.9889 - ETA: 2s - loss: 0.0415 - acc: 0.9889 - ETA: 2s - loss: 0.0414 - acc: 0.9890 - ETA: 1s - loss: 0.0414 - acc: 0.9889 - ETA: 1s - loss: 0.0413 - acc: 0.9889 - ETA: 1s - loss: 0.0411 - acc: 0.9890 - ETA: 1s - loss: 0.0409 - acc: 0.9891 - ETA: 1s - loss: 0.0414 - acc: 0.9888 - ETA: 1s - loss: 0.0433 - acc: 0.9885 - ETA: 1s - loss: 0.0433 - acc: 0.9884 - ETA: 1s - loss: 0.0433 - acc: 0.9884 - ETA: 1s - loss: 0.0441 - acc: 0.9883 - ETA: 1s - loss: 0.0441 - acc: 0.9884 - ETA: 1s - loss: 0.0439 - acc: 0.9884 - ETA: 1s - loss: 0.0441 - acc: 0.9883 - ETA: 1s - loss: 0.0442 - acc: 0.9882 - ETA: 1s - loss: 0.0441 - acc: 0.9883 - ETA: 1s - loss: 0.0440 - acc: 0.9883 - ETA: 1s - loss: 0.0441 - acc: 0.9882 - ETA: 1s - loss: 0.0448 - acc: 0.9879 - ETA: 0s - loss: 0.0453 - acc: 0.9877 - ETA: 0s - loss: 0.0452 - acc: 0.9877 - ETA: 0s - loss: 0.0450 - acc: 0.9878 - ETA: 0s - loss: 0.0455 - acc: 0.9875 - ETA: 0s - loss: 0.0455 - acc: 0.9874 - ETA: 0s - loss: 0.0454 - acc: 0.9875 - ETA: 0s - loss: 0.0453 - acc: 0.9875 - ETA: 0s - loss: 0.0472 - acc: 0.9874 - ETA: 0s - loss: 0.0472 - acc: 0.9875 - ETA: 0s - loss: 0.0471 - acc: 0.9875 - ETA: 0s - loss: 0.0471 - acc: 0.9875 - ETA: 0s - loss: 0.0471 - acc: 0.9876 - ETA: 0s - loss: 0.0471 - acc: 0.9876 - ETA: 0s - loss: 0.0470 - acc: 0.9877 - ETA: 0s - loss: 0.0469 - acc: 0.9877 - ETA: 0s - loss: 0.0468 - acc: 0.9877 - ETA: 0s - loss: 0.0468 - acc: 0.9878 - ETA: 0s - loss: 0.0467 - acc: 0.9878 - ETA: 0s - loss: 0.0466 - acc: 0.9878Epoch 00007: val_loss did not improve
6680/6680 [==============================] - 14s - loss: 0.0468 - acc: 0.9877 - val_loss: 0.7267 - val_acc: 0.8072
Epoch 9/20
6640/6680 [============================>.] - ETA: 9s - loss: 0.0179 - acc: 1.0000 - ETA: 11s - loss: 0.0081 - acc: 1.0000 - ETA: 12s - loss: 0.0073 - acc: 1.0000 - ETA: 13s - loss: 0.0073 - acc: 1.0000 - ETA: 12s - loss: 0.0080 - acc: 1.0000 - ETA: 13s - loss: 0.0076 - acc: 1.0000 - ETA: 13s - loss: 0.0072 - acc: 1.0000 - ETA: 13s - loss: 0.0278 - acc: 0.9950 - ETA: 14s - loss: 0.0278 - acc: 0.9955 - ETA: 14s - loss: 0.0281 - acc: 0.9958 - ETA: 14s - loss: 0.0265 - acc: 0.9962 - ETA: 14s - loss: 0.0341 - acc: 0.9929 - ETA: 14s - loss: 0.0321 - acc: 0.9933 - ETA: 14s - loss: 0.0307 - acc: 0.9937 - ETA: 14s - loss: 0.0295 - acc: 0.9941 - ETA: 14s - loss: 0.0288 - acc: 0.9944 - ETA: 14s - loss: 0.0267 - acc: 0.9950 - ETA: 14s - loss: 0.0260 - acc: 0.9952 - ETA: 14s - loss: 0.0255 - acc: 0.9955 - ETA: 14s - loss: 0.0247 - acc: 0.9957 - ETA: 13s - loss: 0.0234 - acc: 0.9960 - ETA: 13s - loss: 0.0226 - acc: 0.9962 - ETA: 13s - loss: 0.0218 - acc: 0.9964 - ETA: 13s - loss: 0.0206 - acc: 0.9967 - ETA: 13s - loss: 0.0200 - acc: 0.9968 - ETA: 13s - loss: 0.0190 - acc: 0.9970 - ETA: 13s - loss: 0.0187 - acc: 0.9971 - ETA: 12s - loss: 0.0206 - acc: 0.9958 - ETA: 12s - loss: 0.0198 - acc: 0.9961 - ETA: 12s - loss: 0.0195 - acc: 0.9962 - ETA: 12s - loss: 0.0196 - acc: 0.9963 - ETA: 12s - loss: 0.0190 - acc: 0.9965 - ETA: 12s - loss: 0.0255 - acc: 0.9956 - ETA: 11s - loss: 0.0255 - acc: 0.9957 - ETA: 11s - loss: 0.0251 - acc: 0.9959 - ETA: 11s - loss: 0.0243 - acc: 0.9961 - ETA: 11s - loss: 0.0250 - acc: 0.9953 - ETA: 11s - loss: 0.0246 - acc: 0.9954 - ETA: 11s - loss: 0.0245 - acc: 0.9955 - ETA: 11s - loss: 0.0249 - acc: 0.9948 - ETA: 11s - loss: 0.0251 - acc: 0.9950 - ETA: 11s - loss: 0.0253 - acc: 0.9951 - ETA: 10s - loss: 0.0292 - acc: 0.9944 - ETA: 10s - loss: 0.0291 - acc: 0.9946 - ETA: 10s - loss: 0.0288 - acc: 0.9947 - ETA: 10s - loss: 0.0286 - acc: 0.9948 - ETA: 10s - loss: 0.0290 - acc: 0.9941 - ETA: 10s - loss: 0.0287 - acc: 0.9943 - ETA: 10s - loss: 0.0285 - acc: 0.9944 - ETA: 10s - loss: 0.0295 - acc: 0.9937 - ETA: 10s - loss: 0.0297 - acc: 0.9938 - ETA: 10s - loss: 0.0292 - acc: 0.9940 - ETA: 10s - loss: 0.0289 - acc: 0.9941 - ETA: 10s - loss: 0.0286 - acc: 0.9942 - ETA: 10s - loss: 0.0282 - acc: 0.9942 - ETA: 10s - loss: 0.0287 - acc: 0.9937 - ETA: 10s - loss: 0.0288 - acc: 0.9938 - ETA: 10s - loss: 0.0286 - acc: 0.9940 - ETA: 10s - loss: 0.0286 - acc: 0.9940 - ETA: 10s - loss: 0.0288 - acc: 0.9941 - ETA: 10s - loss: 0.0284 - acc: 0.9943 - ETA: 9s - loss: 0.0283 - acc: 0.9944  - ETA: 9s - loss: 0.0286 - acc: 0.9939 - ETA: 9s - loss: 0.0287 - acc: 0.9935 - ETA: 9s - loss: 0.0287 - acc: 0.9935 - ETA: 9s - loss: 0.0283 - acc: 0.9937 - ETA: 9s - loss: 0.0285 - acc: 0.9937 - ETA: 9s - loss: 0.0282 - acc: 0.9939 - ETA: 9s - loss: 0.0282 - acc: 0.9939 - ETA: 9s - loss: 0.0278 - acc: 0.9941 - ETA: 9s - loss: 0.0281 - acc: 0.9937 - ETA: 9s - loss: 0.0279 - acc: 0.9937 - ETA: 9s - loss: 0.0286 - acc: 0.9934 - ETA: 9s - loss: 0.0285 - acc: 0.9935 - ETA: 9s - loss: 0.0283 - acc: 0.9936 - ETA: 8s - loss: 0.0288 - acc: 0.9932 - ETA: 8s - loss: 0.0287 - acc: 0.9934 - ETA: 8s - loss: 0.0292 - acc: 0.9935 - ETA: 8s - loss: 0.0318 - acc: 0.9931 - ETA: 8s - loss: 0.0319 - acc: 0.9932 - ETA: 8s - loss: 0.0319 - acc: 0.9929 - ETA: 8s - loss: 0.0315 - acc: 0.9930 - ETA: 8s - loss: 0.0312 - acc: 0.9931 - ETA: 8s - loss: 0.0310 - acc: 0.9932 - ETA: 8s - loss: 0.0312 - acc: 0.9929 - ETA: 8s - loss: 0.0312 - acc: 0.9929 - ETA: 8s - loss: 0.0320 - acc: 0.9926 - ETA: 8s - loss: 0.0318 - acc: 0.9926 - ETA: 8s - loss: 0.0320 - acc: 0.9924 - ETA: 8s - loss: 0.0317 - acc: 0.9925 - ETA: 8s - loss: 0.0315 - acc: 0.9925 - ETA: 7s - loss: 0.0314 - acc: 0.9926 - ETA: 7s - loss: 0.0310 - acc: 0.9927 - ETA: 7s - loss: 0.0311 - acc: 0.9924 - ETA: 7s - loss: 0.0309 - acc: 0.9925 - ETA: 7s - loss: 0.0306 - acc: 0.9926 - ETA: 7s - loss: 0.0309 - acc: 0.9923 - ETA: 7s - loss: 0.0312 - acc: 0.9921 - ETA: 7s - loss: 0.0309 - acc: 0.9922 - ETA: 7s - loss: 0.0308 - acc: 0.9922 - ETA: 7s - loss: 0.0306 - acc: 0.9923 - ETA: 7s - loss: 0.0306 - acc: 0.9923 - ETA: 7s - loss: 0.0306 - acc: 0.9924 - ETA: 7s - loss: 0.0304 - acc: 0.9925 - ETA: 7s - loss: 0.0303 - acc: 0.9926 - ETA: 7s - loss: 0.0300 - acc: 0.9927 - ETA: 6s - loss: 0.0316 - acc: 0.9921 - ETA: 6s - loss: 0.0321 - acc: 0.9919 - ETA: 6s - loss: 0.0322 - acc: 0.9916 - ETA: 6s - loss: 0.0322 - acc: 0.9917 - ETA: 6s - loss: 0.0319 - acc: 0.9918 - ETA: 6s - loss: 0.0318 - acc: 0.9919 - ETA: 6s - loss: 0.0318 - acc: 0.9917 - ETA: 6s - loss: 0.0317 - acc: 0.9918 - ETA: 6s - loss: 0.0315 - acc: 0.9918 - ETA: 6s - loss: 0.0314 - acc: 0.9919 - ETA: 6s - loss: 0.0313 - acc: 0.9917 - ETA: 6s - loss: 0.0313 - acc: 0.9915 - ETA: 6s - loss: 0.0313 - acc: 0.9915 - ETA: 6s - loss: 0.0310 - acc: 0.9916 - ETA: 6s - loss: 0.0308 - acc: 0.9917 - ETA: 5s - loss: 0.0310 - acc: 0.9915 - ETA: 5s - loss: 0.0309 - acc: 0.9916 - ETA: 5s - loss: 0.0308 - acc: 0.9914 - ETA: 5s - loss: 0.0306 - acc: 0.9915 - ETA: 5s - loss: 0.0306 - acc: 0.9916 - ETA: 5s - loss: 0.0304 - acc: 0.9917 - ETA: 5s - loss: 0.0303 - acc: 0.9918 - ETA: 5s - loss: 0.0303 - acc: 0.9915 - ETA: 5s - loss: 0.0302 - acc: 0.9916 - ETA: 5s - loss: 0.0301 - acc: 0.9916 - ETA: 5s - loss: 0.0301 - acc: 0.9917 - ETA: 5s - loss: 0.0302 - acc: 0.9915 - ETA: 5s - loss: 0.0302 - acc: 0.9916 - ETA: 5s - loss: 0.0303 - acc: 0.9914 - ETA: 5s - loss: 0.0302 - acc: 0.9914 - ETA: 5s - loss: 0.0300 - acc: 0.9915 - ETA: 5s - loss: 0.0299 - acc: 0.9915 - ETA: 4s - loss: 0.0299 - acc: 0.9916 - ETA: 4s - loss: 0.0296 - acc: 0.9917 - ETA: 4s - loss: 0.0295 - acc: 0.9917 - ETA: 4s - loss: 0.0294 - acc: 0.9918 - ETA: 4s - loss: 0.0293 - acc: 0.9919 - ETA: 4s - loss: 0.0294 - acc: 0.9917 - ETA: 4s - loss: 0.0294 - acc: 0.9916 - ETA: 4s - loss: 0.0295 - acc: 0.9916 - ETA: 4s - loss: 0.0295 - acc: 0.9917 - ETA: 4s - loss: 0.0308 - acc: 0.9911 - ETA: 4s - loss: 0.0307 - acc: 0.9911 - ETA: 4s - loss: 0.0307 - acc: 0.9912 - ETA: 4s - loss: 0.0307 - acc: 0.9912 - ETA: 4s - loss: 0.0308 - acc: 0.9910 - ETA: 4s - loss: 0.0308 - acc: 0.9911 - ETA: 4s - loss: 0.0309 - acc: 0.9912 - ETA: 3s - loss: 0.0308 - acc: 0.9912 - ETA: 3s - loss: 0.0310 - acc: 0.9910 - ETA: 3s - loss: 0.0320 - acc: 0.9907 - ETA: 3s - loss: 0.0320 - acc: 0.9907 - ETA: 3s - loss: 0.0334 - acc: 0.9906 - ETA: 3s - loss: 0.0332 - acc: 0.9907 - ETA: 3s - loss: 0.0335 - acc: 0.9905 - ETA: 3s - loss: 0.0334 - acc: 0.9906 - ETA: 3s - loss: 0.0335 - acc: 0.9907 - ETA: 3s - loss: 0.0335 - acc: 0.9907 - ETA: 3s - loss: 0.0335 - acc: 0.9906 - ETA: 3s - loss: 0.0346 - acc: 0.9902 - ETA: 3s - loss: 0.0345 - acc: 0.9903 - ETA: 3s - loss: 0.0344 - acc: 0.9903 - ETA: 3s - loss: 0.0348 - acc: 0.9902 - ETA: 3s - loss: 0.0355 - acc: 0.9901 - ETA: 2s - loss: 0.0354 - acc: 0.9902 - ETA: 2s - loss: 0.0353 - acc: 0.9902 - ETA: 2s - loss: 0.0352 - acc: 0.9902 - ETA: 2s - loss: 0.0354 - acc: 0.9901 - ETA: 2s - loss: 0.0352 - acc: 0.9902 - ETA: 2s - loss: 0.0351 - acc: 0.9902 - ETA: 2s - loss: 0.0350 - acc: 0.9903 - ETA: 2s - loss: 0.0349 - acc: 0.9903 - ETA: 2s - loss: 0.0355 - acc: 0.9901 - ETA: 2s - loss: 0.0358 - acc: 0.9900 - ETA: 2s - loss: 0.0357 - acc: 0.9900 - ETA: 2s - loss: 0.0357 - acc: 0.9901 - ETA: 2s - loss: 0.0358 - acc: 0.9900 - ETA: 2s - loss: 0.0357 - acc: 0.9900 - ETA: 2s - loss: 0.0356 - acc: 0.9901 - ETA: 2s - loss: 0.0354 - acc: 0.9902 - ETA: 2s - loss: 0.0353 - acc: 0.9902 - ETA: 1s - loss: 0.0352 - acc: 0.9903 - ETA: 1s - loss: 0.0351 - acc: 0.9904 - ETA: 1s - loss: 0.0351 - acc: 0.9904 - ETA: 1s - loss: 0.0349 - acc: 0.9905 - ETA: 1s - loss: 0.0348 - acc: 0.9905 - ETA: 1s - loss: 0.0352 - acc: 0.9904 - ETA: 1s - loss: 0.0352 - acc: 0.9904 - ETA: 1s - loss: 0.0351 - acc: 0.9905 - ETA: 1s - loss: 0.0350 - acc: 0.9905 - ETA: 1s - loss: 0.0353 - acc: 0.9904 - ETA: 1s - loss: 0.0352 - acc: 0.9904 - ETA: 1s - loss: 0.0356 - acc: 0.9902 - ETA: 1s - loss: 0.0358 - acc: 0.9900 - ETA: 1s - loss: 0.0357 - acc: 0.9901 - ETA: 1s - loss: 0.0355 - acc: 0.9901 - ETA: 1s - loss: 0.0354 - acc: 0.9902 - ETA: 1s - loss: 0.0352 - acc: 0.9902 - ETA: 0s - loss: 0.0354 - acc: 0.9901 - ETA: 0s - loss: 0.0354 - acc: 0.9900 - ETA: 0s - loss: 0.0353 - acc: 0.9901 - ETA: 0s - loss: 0.0352 - acc: 0.9901 - ETA: 0s - loss: 0.0351 - acc: 0.9902 - ETA: 0s - loss: 0.0350 - acc: 0.9902 - ETA: 0s - loss: 0.0348 - acc: 0.9903 - ETA: 0s - loss: 0.0353 - acc: 0.9902 - ETA: 0s - loss: 0.0352 - acc: 0.9902 - ETA: 0s - loss: 0.0350 - acc: 0.9903 - ETA: 0s - loss: 0.0350 - acc: 0.9903 - ETA: 0s - loss: 0.0357 - acc: 0.9902 - ETA: 0s - loss: 0.0355 - acc: 0.9903 - ETA: 0s - loss: 0.0358 - acc: 0.9902 - ETA: 0s - loss: 0.0358 - acc: 0.9902Epoch 00008: val_loss did not improve
6680/6680 [==============================] - 13s - loss: 0.0358 - acc: 0.9901 - val_loss: 0.7238 - val_acc: 0.8180
Epoch 10/20
6660/6680 [============================>.] - ETA: 6s - loss: 0.0088 - acc: 1.0000 - ETA: 8s - loss: 0.0287 - acc: 0.9833 - ETA: 10s - loss: 0.0228 - acc: 0.9875 - ETA: 10s - loss: 0.0203 - acc: 0.9917 - ETA: 11s - loss: 0.0177 - acc: 0.9929 - ETA: 11s - loss: 0.0157 - acc: 0.9944 - ETA: 11s - loss: 0.0135 - acc: 0.9955 - ETA: 11s - loss: 0.0389 - acc: 0.9917 - ETA: 11s - loss: 0.0367 - acc: 0.9923 - ETA: 12s - loss: 0.0347 - acc: 0.9929 - ETA: 11s - loss: 0.0316 - acc: 0.9937 - ETA: 11s - loss: 0.0329 - acc: 0.9912 - ETA: 11s - loss: 0.0342 - acc: 0.9921 - ETA: 11s - loss: 0.0400 - acc: 0.9881 - ETA: 11s - loss: 0.0439 - acc: 0.9864 - ETA: 11s - loss: 0.0406 - acc: 0.9875 - ETA: 11s - loss: 0.0379 - acc: 0.9885 - ETA: 11s - loss: 0.0376 - acc: 0.9889 - ETA: 11s - loss: 0.0364 - acc: 0.9893 - ETA: 11s - loss: 0.0358 - acc: 0.9883 - ETA: 11s - loss: 0.0343 - acc: 0.9891 - ETA: 11s - loss: 0.0334 - acc: 0.9894 - ETA: 11s - loss: 0.0324 - acc: 0.9900 - ETA: 11s - loss: 0.0322 - acc: 0.9903 - ETA: 11s - loss: 0.0314 - acc: 0.9905 - ETA: 11s - loss: 0.0302 - acc: 0.9910 - ETA: 11s - loss: 0.0296 - acc: 0.9912 - ETA: 11s - loss: 0.0290 - acc: 0.9915 - ETA: 11s - loss: 0.0289 - acc: 0.9917 - ETA: 11s - loss: 0.0346 - acc: 0.9907 - ETA: 11s - loss: 0.0338 - acc: 0.9909 - ETA: 11s - loss: 0.0331 - acc: 0.9911 - ETA: 11s - loss: 0.0320 - acc: 0.9915 - ETA: 11s - loss: 0.0315 - acc: 0.9918 - ETA: 10s - loss: 0.0312 - acc: 0.9922 - ETA: 10s - loss: 0.0328 - acc: 0.9913 - ETA: 10s - loss: 0.0338 - acc: 0.9906 - ETA: 10s - loss: 0.0343 - acc: 0.9909 - ETA: 10s - loss: 0.0341 - acc: 0.9911 - ETA: 10s - loss: 0.0332 - acc: 0.9914 - ETA: 10s - loss: 0.0326 - acc: 0.9917 - ETA: 10s - loss: 0.0320 - acc: 0.9918 - ETA: 10s - loss: 0.0315 - acc: 0.9919 - ETA: 10s - loss: 0.0311 - acc: 0.9921 - ETA: 10s - loss: 0.0306 - acc: 0.9923 - ETA: 10s - loss: 0.0301 - acc: 0.9924 - ETA: 10s - loss: 0.0298 - acc: 0.9925 - ETA: 10s - loss: 0.0291 - acc: 0.9928 - ETA: 10s - loss: 0.0284 - acc: 0.9930 - ETA: 10s - loss: 0.0307 - acc: 0.9924 - ETA: 10s - loss: 0.0301 - acc: 0.9926 - ETA: 10s - loss: 0.0300 - acc: 0.9921 - ETA: 9s - loss: 0.0295 - acc: 0.9923  - ETA: 9s - loss: 0.0295 - acc: 0.9925 - ETA: 9s - loss: 0.0293 - acc: 0.9926 - ETA: 9s - loss: 0.0290 - acc: 0.9927 - ETA: 9s - loss: 0.0287 - acc: 0.9928 - ETA: 9s - loss: 0.0284 - acc: 0.9929 - ETA: 9s - loss: 0.0279 - acc: 0.9931 - ETA: 9s - loss: 0.0278 - acc: 0.9933 - ETA: 9s - loss: 0.0274 - acc: 0.9934 - ETA: 9s - loss: 0.0273 - acc: 0.9935 - ETA: 9s - loss: 0.0271 - acc: 0.9935 - ETA: 9s - loss: 0.0267 - acc: 0.9937 - ETA: 9s - loss: 0.0265 - acc: 0.9937 - ETA: 9s - loss: 0.0263 - acc: 0.9938 - ETA: 9s - loss: 0.0262 - acc: 0.9939 - ETA: 9s - loss: 0.0259 - acc: 0.9939 - ETA: 9s - loss: 0.0256 - acc: 0.9941 - ETA: 9s - loss: 0.0254 - acc: 0.9941 - ETA: 8s - loss: 0.0249 - acc: 0.9942 - ETA: 8s - loss: 0.0247 - acc: 0.9943 - ETA: 8s - loss: 0.0249 - acc: 0.9944 - ETA: 8s - loss: 0.0246 - acc: 0.9945 - ETA: 8s - loss: 0.0245 - acc: 0.9946 - ETA: 8s - loss: 0.0245 - acc: 0.9942 - ETA: 8s - loss: 0.0244 - acc: 0.9943 - ETA: 8s - loss: 0.0242 - acc: 0.9943 - ETA: 8s - loss: 0.0242 - acc: 0.9944 - ETA: 8s - loss: 0.0240 - acc: 0.9945 - ETA: 8s - loss: 0.0239 - acc: 0.9946 - ETA: 8s - loss: 0.0237 - acc: 0.9947 - ETA: 8s - loss: 0.0235 - acc: 0.9948 - ETA: 8s - loss: 0.0231 - acc: 0.9948 - ETA: 7s - loss: 0.0249 - acc: 0.9945 - ETA: 7s - loss: 0.0248 - acc: 0.9946 - ETA: 7s - loss: 0.0246 - acc: 0.9947 - ETA: 7s - loss: 0.0243 - acc: 0.9947 - ETA: 7s - loss: 0.0242 - acc: 0.9948 - ETA: 7s - loss: 0.0241 - acc: 0.9949 - ETA: 7s - loss: 0.0239 - acc: 0.9949 - ETA: 7s - loss: 0.0237 - acc: 0.9950 - ETA: 7s - loss: 0.0236 - acc: 0.9950 - ETA: 7s - loss: 0.0235 - acc: 0.9951 - ETA: 7s - loss: 0.0235 - acc: 0.9951 - ETA: 7s - loss: 0.0234 - acc: 0.9952 - ETA: 7s - loss: 0.0232 - acc: 0.9952 - ETA: 7s - loss: 0.0231 - acc: 0.9953 - ETA: 7s - loss: 0.0236 - acc: 0.9950 - ETA: 7s - loss: 0.0239 - acc: 0.9947 - ETA: 6s - loss: 0.0241 - acc: 0.9944 - ETA: 6s - loss: 0.0239 - acc: 0.9945 - ETA: 6s - loss: 0.0239 - acc: 0.9946 - ETA: 6s - loss: 0.0242 - acc: 0.9943 - ETA: 6s - loss: 0.0240 - acc: 0.9943 - ETA: 6s - loss: 0.0239 - acc: 0.9943 - ETA: 6s - loss: 0.0239 - acc: 0.9944 - ETA: 6s - loss: 0.0239 - acc: 0.9944 - ETA: 6s - loss: 0.0238 - acc: 0.9944 - ETA: 6s - loss: 0.0237 - acc: 0.9945 - ETA: 6s - loss: 0.0236 - acc: 0.9946 - ETA: 6s - loss: 0.0235 - acc: 0.9946 - ETA: 6s - loss: 0.0234 - acc: 0.9947 - ETA: 6s - loss: 0.0232 - acc: 0.9947 - ETA: 6s - loss: 0.0233 - acc: 0.9945 - ETA: 6s - loss: 0.0232 - acc: 0.9945 - ETA: 6s - loss: 0.0230 - acc: 0.9946 - ETA: 5s - loss: 0.0235 - acc: 0.9941 - ETA: 5s - loss: 0.0235 - acc: 0.9941 - ETA: 5s - loss: 0.0235 - acc: 0.9942 - ETA: 5s - loss: 0.0233 - acc: 0.9942 - ETA: 5s - loss: 0.0234 - acc: 0.9943 - ETA: 5s - loss: 0.0232 - acc: 0.9943 - ETA: 5s - loss: 0.0231 - acc: 0.9944 - ETA: 5s - loss: 0.0230 - acc: 0.9944 - ETA: 5s - loss: 0.0230 - acc: 0.9944 - ETA: 5s - loss: 0.0229 - acc: 0.9945 - ETA: 5s - loss: 0.0232 - acc: 0.9945 - ETA: 5s - loss: 0.0237 - acc: 0.9943 - ETA: 5s - loss: 0.0236 - acc: 0.9943 - ETA: 5s - loss: 0.0236 - acc: 0.9944 - ETA: 5s - loss: 0.0236 - acc: 0.9944 - ETA: 5s - loss: 0.0238 - acc: 0.9942 - ETA: 5s - loss: 0.0239 - acc: 0.9942 - ETA: 5s - loss: 0.0243 - acc: 0.9938 - ETA: 5s - loss: 0.0242 - acc: 0.9938 - ETA: 5s - loss: 0.0243 - acc: 0.9939 - ETA: 4s - loss: 0.0242 - acc: 0.9939 - ETA: 4s - loss: 0.0240 - acc: 0.9940 - ETA: 4s - loss: 0.0240 - acc: 0.9940 - ETA: 4s - loss: 0.0240 - acc: 0.9940 - ETA: 4s - loss: 0.0239 - acc: 0.9941 - ETA: 4s - loss: 0.0239 - acc: 0.9941 - ETA: 4s - loss: 0.0238 - acc: 0.9941 - ETA: 4s - loss: 0.0237 - acc: 0.9942 - ETA: 4s - loss: 0.0236 - acc: 0.9942 - ETA: 4s - loss: 0.0235 - acc: 0.9943 - ETA: 4s - loss: 0.0238 - acc: 0.9941 - ETA: 4s - loss: 0.0237 - acc: 0.9941 - ETA: 4s - loss: 0.0257 - acc: 0.9935 - ETA: 4s - loss: 0.0262 - acc: 0.9933 - ETA: 4s - loss: 0.0263 - acc: 0.9931 - ETA: 4s - loss: 0.0263 - acc: 0.9931 - ETA: 4s - loss: 0.0260 - acc: 0.9932 - ETA: 4s - loss: 0.0262 - acc: 0.9930 - ETA: 4s - loss: 0.0265 - acc: 0.9928 - ETA: 3s - loss: 0.0271 - acc: 0.9927 - ETA: 3s - loss: 0.0270 - acc: 0.9927 - ETA: 3s - loss: 0.0277 - acc: 0.9926 - ETA: 3s - loss: 0.0282 - acc: 0.9924 - ETA: 3s - loss: 0.0281 - acc: 0.9924 - ETA: 3s - loss: 0.0280 - acc: 0.9924 - ETA: 3s - loss: 0.0279 - acc: 0.9925 - ETA: 3s - loss: 0.0279 - acc: 0.9925 - ETA: 3s - loss: 0.0278 - acc: 0.9926 - ETA: 3s - loss: 0.0277 - acc: 0.9926 - ETA: 3s - loss: 0.0276 - acc: 0.9926 - ETA: 3s - loss: 0.0275 - acc: 0.9927 - ETA: 3s - loss: 0.0275 - acc: 0.9927 - ETA: 3s - loss: 0.0274 - acc: 0.9927 - ETA: 3s - loss: 0.0274 - acc: 0.9927 - ETA: 3s - loss: 0.0275 - acc: 0.9926 - ETA: 3s - loss: 0.0274 - acc: 0.9926 - ETA: 3s - loss: 0.0273 - acc: 0.9926 - ETA: 3s - loss: 0.0273 - acc: 0.9927 - ETA: 3s - loss: 0.0279 - acc: 0.9925 - ETA: 3s - loss: 0.0278 - acc: 0.9925 - ETA: 3s - loss: 0.0278 - acc: 0.9925 - ETA: 3s - loss: 0.0277 - acc: 0.9926 - ETA: 3s - loss: 0.0279 - acc: 0.9924 - ETA: 3s - loss: 0.0278 - acc: 0.9924 - ETA: 3s - loss: 0.0277 - acc: 0.9925 - ETA: 2s - loss: 0.0277 - acc: 0.9923 - ETA: 2s - loss: 0.0279 - acc: 0.9922 - ETA: 2s - loss: 0.0278 - acc: 0.9922 - ETA: 2s - loss: 0.0277 - acc: 0.9923 - ETA: 2s - loss: 0.0276 - acc: 0.9923 - ETA: 2s - loss: 0.0275 - acc: 0.9923 - ETA: 2s - loss: 0.0275 - acc: 0.9924 - ETA: 2s - loss: 0.0275 - acc: 0.9924 - ETA: 2s - loss: 0.0274 - acc: 0.9924 - ETA: 2s - loss: 0.0273 - acc: 0.9924 - ETA: 2s - loss: 0.0272 - acc: 0.9925 - ETA: 2s - loss: 0.0272 - acc: 0.9925 - ETA: 2s - loss: 0.0273 - acc: 0.9925 - ETA: 2s - loss: 0.0272 - acc: 0.9925 - ETA: 2s - loss: 0.0272 - acc: 0.9926 - ETA: 2s - loss: 0.0273 - acc: 0.9924 - ETA: 2s - loss: 0.0272 - acc: 0.9924 - ETA: 2s - loss: 0.0272 - acc: 0.9925 - ETA: 2s - loss: 0.0272 - acc: 0.9925 - ETA: 2s - loss: 0.0272 - acc: 0.9925 - ETA: 2s - loss: 0.0273 - acc: 0.9924 - ETA: 2s - loss: 0.0276 - acc: 0.9922 - ETA: 2s - loss: 0.0276 - acc: 0.9923 - ETA: 2s - loss: 0.0275 - acc: 0.9923 - ETA: 2s - loss: 0.0274 - acc: 0.9923 - ETA: 2s - loss: 0.0274 - acc: 0.9923 - ETA: 2s - loss: 0.0274 - acc: 0.9924 - ETA: 1s - loss: 0.0273 - acc: 0.9924 - ETA: 1s - loss: 0.0272 - acc: 0.9924 - ETA: 1s - loss: 0.0277 - acc: 0.9923 - ETA: 1s - loss: 0.0276 - acc: 0.9923 - ETA: 1s - loss: 0.0276 - acc: 0.9923 - ETA: 1s - loss: 0.0276 - acc: 0.9923 - ETA: 1s - loss: 0.0275 - acc: 0.9924 - ETA: 1s - loss: 0.0275 - acc: 0.9924 - ETA: 1s - loss: 0.0276 - acc: 0.9923 - ETA: 1s - loss: 0.0276 - acc: 0.9923 - ETA: 1s - loss: 0.0275 - acc: 0.9923 - ETA: 1s - loss: 0.0275 - acc: 0.9923 - ETA: 1s - loss: 0.0274 - acc: 0.9924 - ETA: 1s - loss: 0.0273 - acc: 0.9924 - ETA: 1s - loss: 0.0273 - acc: 0.9924 - ETA: 1s - loss: 0.0273 - acc: 0.9924 - ETA: 1s - loss: 0.0272 - acc: 0.9925 - ETA: 1s - loss: 0.0272 - acc: 0.9925 - ETA: 1s - loss: 0.0271 - acc: 0.9925 - ETA: 1s - loss: 0.0270 - acc: 0.9925 - ETA: 1s - loss: 0.0270 - acc: 0.9926 - ETA: 1s - loss: 0.0275 - acc: 0.9924 - ETA: 1s - loss: 0.0275 - acc: 0.9924 - ETA: 0s - loss: 0.0274 - acc: 0.9925 - ETA: 0s - loss: 0.0274 - acc: 0.9925 - ETA: 0s - loss: 0.0275 - acc: 0.9924 - ETA: 0s - loss: 0.0276 - acc: 0.9923 - ETA: 0s - loss: 0.0276 - acc: 0.9923 - ETA: 0s - loss: 0.0275 - acc: 0.9923 - ETA: 0s - loss: 0.0273 - acc: 0.9924 - ETA: 0s - loss: 0.0278 - acc: 0.9923 - ETA: 0s - loss: 0.0277 - acc: 0.9923 - ETA: 0s - loss: 0.0276 - acc: 0.9924 - ETA: 0s - loss: 0.0277 - acc: 0.9922 - ETA: 0s - loss: 0.0276 - acc: 0.9923 - ETA: 0s - loss: 0.0276 - acc: 0.9923Epoch 00009: val_loss did not improve
6680/6680 [==============================] - 15s - loss: 0.0275 - acc: 0.9924 - val_loss: 0.7656 - val_acc: 0.8180
Epoch 11/20
6660/6680 [============================>.] - ETA: 9s - loss: 0.0041 - acc: 1.0000 - ETA: 11s - loss: 0.0138 - acc: 1.0000 - ETA: 10s - loss: 0.0113 - acc: 1.0000 - ETA: 11s - loss: 0.0102 - acc: 1.0000 - ETA: 12s - loss: 0.0095 - acc: 1.0000 - ETA: 12s - loss: 0.0093 - acc: 1.0000 - ETA: 12s - loss: 0.0078 - acc: 1.0000 - ETA: 12s - loss: 0.0086 - acc: 1.0000 - ETA: 12s - loss: 0.0088 - acc: 1.0000 - ETA: 12s - loss: 0.0085 - acc: 1.0000 - ETA: 12s - loss: 0.0081 - acc: 1.0000 - ETA: 12s - loss: 0.0122 - acc: 1.0000 - ETA: 12s - loss: 0.0138 - acc: 0.9974 - ETA: 12s - loss: 0.0135 - acc: 0.9975 - ETA: 12s - loss: 0.0136 - acc: 0.9977 - ETA: 11s - loss: 0.0136 - acc: 0.9979 - ETA: 11s - loss: 0.0131 - acc: 0.9980 - ETA: 12s - loss: 0.0127 - acc: 0.9981 - ETA: 12s - loss: 0.0125 - acc: 0.9981 - ETA: 11s - loss: 0.0124 - acc: 0.9983 - ETA: 12s - loss: 0.0132 - acc: 0.9983 - ETA: 11s - loss: 0.0133 - acc: 0.9984 - ETA: 11s - loss: 0.0132 - acc: 0.9985 - ETA: 12s - loss: 0.0128 - acc: 0.9985 - ETA: 12s - loss: 0.0137 - acc: 0.9971 - ETA: 12s - loss: 0.0135 - acc: 0.9972 - ETA: 12s - loss: 0.0133 - acc: 0.9973 - ETA: 12s - loss: 0.0135 - acc: 0.9974 - ETA: 12s - loss: 0.0134 - acc: 0.9974 - ETA: 12s - loss: 0.0154 - acc: 0.9962 - ETA: 12s - loss: 0.0149 - acc: 0.9964 - ETA: 12s - loss: 0.0153 - acc: 0.9965 - ETA: 12s - loss: 0.0158 - acc: 0.9966 - ETA: 12s - loss: 0.0166 - acc: 0.9956 - ETA: 12s - loss: 0.0162 - acc: 0.9957 - ETA: 12s - loss: 0.0160 - acc: 0.9957 - ETA: 12s - loss: 0.0159 - acc: 0.9958 - ETA: 13s - loss: 0.0157 - acc: 0.9959 - ETA: 13s - loss: 0.0154 - acc: 0.9960 - ETA: 13s - loss: 0.0152 - acc: 0.9961 - ETA: 13s - loss: 0.0149 - acc: 0.9962 - ETA: 13s - loss: 0.0149 - acc: 0.9962 - ETA: 13s - loss: 0.0147 - acc: 0.9963 - ETA: 13s - loss: 0.0146 - acc: 0.9964 - ETA: 14s - loss: 0.0154 - acc: 0.9955 - ETA: 14s - loss: 0.0153 - acc: 0.9956 - ETA: 14s - loss: 0.0151 - acc: 0.9957 - ETA: 14s - loss: 0.0149 - acc: 0.9958 - ETA: 14s - loss: 0.0147 - acc: 0.9958 - ETA: 14s - loss: 0.0146 - acc: 0.9959 - ETA: 14s - loss: 0.0144 - acc: 0.9960 - ETA: 14s - loss: 0.0142 - acc: 0.9960 - ETA: 14s - loss: 0.0142 - acc: 0.9961 - ETA: 14s - loss: 0.0140 - acc: 0.9962 - ETA: 14s - loss: 0.0140 - acc: 0.9962 - ETA: 14s - loss: 0.0140 - acc: 0.9963 - ETA: 14s - loss: 0.0139 - acc: 0.9963 - ETA: 14s - loss: 0.0137 - acc: 0.9964 - ETA: 14s - loss: 0.0136 - acc: 0.9964 - ETA: 14s - loss: 0.0143 - acc: 0.9958 - ETA: 14s - loss: 0.0141 - acc: 0.9958 - ETA: 14s - loss: 0.0140 - acc: 0.9959 - ETA: 14s - loss: 0.0138 - acc: 0.9959 - ETA: 14s - loss: 0.0138 - acc: 0.9960 - ETA: 14s - loss: 0.0137 - acc: 0.9961 - ETA: 14s - loss: 0.0136 - acc: 0.9961 - ETA: 14s - loss: 0.0137 - acc: 0.9962 - ETA: 14s - loss: 0.0135 - acc: 0.9962 - ETA: 14s - loss: 0.0134 - acc: 0.9962 - ETA: 14s - loss: 0.0134 - acc: 0.9963 - ETA: 14s - loss: 0.0133 - acc: 0.9963 - ETA: 14s - loss: 0.0132 - acc: 0.9964 - ETA: 14s - loss: 0.0131 - acc: 0.9965 - ETA: 14s - loss: 0.0132 - acc: 0.9965 - ETA: 14s - loss: 0.0132 - acc: 0.9966 - ETA: 14s - loss: 0.0132 - acc: 0.9966 - ETA: 14s - loss: 0.0132 - acc: 0.9966 - ETA: 14s - loss: 0.0131 - acc: 0.9967 - ETA: 13s - loss: 0.0129 - acc: 0.9967 - ETA: 13s - loss: 0.0135 - acc: 0.9962 - ETA: 13s - loss: 0.0172 - acc: 0.9957 - ETA: 13s - loss: 0.0170 - acc: 0.9958 - ETA: 13s - loss: 0.0169 - acc: 0.9958 - ETA: 13s - loss: 0.0168 - acc: 0.9959 - ETA: 13s - loss: 0.0166 - acc: 0.9959 - ETA: 13s - loss: 0.0165 - acc: 0.9960 - ETA: 13s - loss: 0.0164 - acc: 0.9960 - ETA: 13s - loss: 0.0165 - acc: 0.9960 - ETA: 12s - loss: 0.0169 - acc: 0.9956 - ETA: 12s - loss: 0.0168 - acc: 0.9957 - ETA: 12s - loss: 0.0167 - acc: 0.9958 - ETA: 12s - loss: 0.0165 - acc: 0.9958 - ETA: 12s - loss: 0.0163 - acc: 0.9959 - ETA: 12s - loss: 0.0161 - acc: 0.9960 - ETA: 11s - loss: 0.0160 - acc: 0.9961 - ETA: 11s - loss: 0.0159 - acc: 0.9961 - ETA: 11s - loss: 0.0161 - acc: 0.9962 - ETA: 11s - loss: 0.0164 - acc: 0.9958 - ETA: 11s - loss: 0.0165 - acc: 0.9959 - ETA: 11s - loss: 0.0167 - acc: 0.9955 - ETA: 10s - loss: 0.0167 - acc: 0.9956 - ETA: 10s - loss: 0.0166 - acc: 0.9956 - ETA: 10s - loss: 0.0165 - acc: 0.9957 - ETA: 10s - loss: 0.0163 - acc: 0.9958 - ETA: 10s - loss: 0.0162 - acc: 0.9958 - ETA: 10s - loss: 0.0163 - acc: 0.9955 - ETA: 10s - loss: 0.0162 - acc: 0.9956 - ETA: 10s - loss: 0.0160 - acc: 0.9956 - ETA: 10s - loss: 0.0160 - acc: 0.9957 - ETA: 9s - loss: 0.0160 - acc: 0.9957  - ETA: 9s - loss: 0.0160 - acc: 0.9957 - ETA: 9s - loss: 0.0159 - acc: 0.9958 - ETA: 9s - loss: 0.0161 - acc: 0.9955 - ETA: 9s - loss: 0.0162 - acc: 0.9955 - ETA: 9s - loss: 0.0161 - acc: 0.9956 - ETA: 9s - loss: 0.0161 - acc: 0.9956 - ETA: 9s - loss: 0.0162 - acc: 0.9957 - ETA: 9s - loss: 0.0161 - acc: 0.9957 - ETA: 8s - loss: 0.0160 - acc: 0.9958 - ETA: 8s - loss: 0.0159 - acc: 0.9958 - ETA: 8s - loss: 0.0176 - acc: 0.9952 - ETA: 8s - loss: 0.0175 - acc: 0.9953 - ETA: 8s - loss: 0.0176 - acc: 0.9953 - ETA: 8s - loss: 0.0177 - acc: 0.9954 - ETA: 8s - loss: 0.0176 - acc: 0.9954 - ETA: 8s - loss: 0.0178 - acc: 0.9952 - ETA: 8s - loss: 0.0189 - acc: 0.9949 - ETA: 7s - loss: 0.0188 - acc: 0.9950 - ETA: 7s - loss: 0.0188 - acc: 0.9950 - ETA: 7s - loss: 0.0187 - acc: 0.9950 - ETA: 7s - loss: 0.0201 - acc: 0.9948 - ETA: 7s - loss: 0.0199 - acc: 0.9949 - ETA: 7s - loss: 0.0198 - acc: 0.9949 - ETA: 7s - loss: 0.0196 - acc: 0.9949 - ETA: 7s - loss: 0.0196 - acc: 0.9950 - ETA: 7s - loss: 0.0195 - acc: 0.9951 - ETA: 7s - loss: 0.0194 - acc: 0.9951 - ETA: 7s - loss: 0.0194 - acc: 0.9951 - ETA: 7s - loss: 0.0193 - acc: 0.9952 - ETA: 6s - loss: 0.0197 - acc: 0.9949 - ETA: 6s - loss: 0.0196 - acc: 0.9950 - ETA: 6s - loss: 0.0196 - acc: 0.9950 - ETA: 6s - loss: 0.0196 - acc: 0.9950 - ETA: 6s - loss: 0.0196 - acc: 0.9951 - ETA: 6s - loss: 0.0195 - acc: 0.9951 - ETA: 6s - loss: 0.0195 - acc: 0.9951 - ETA: 6s - loss: 0.0196 - acc: 0.9949 - ETA: 6s - loss: 0.0195 - acc: 0.9950 - ETA: 6s - loss: 0.0194 - acc: 0.9950 - ETA: 6s - loss: 0.0193 - acc: 0.9950 - ETA: 6s - loss: 0.0193 - acc: 0.9950 - ETA: 6s - loss: 0.0192 - acc: 0.9951 - ETA: 6s - loss: 0.0192 - acc: 0.9951 - ETA: 6s - loss: 0.0195 - acc: 0.9949 - ETA: 5s - loss: 0.0196 - acc: 0.9950 - ETA: 5s - loss: 0.0195 - acc: 0.9950 - ETA: 5s - loss: 0.0194 - acc: 0.9950 - ETA: 5s - loss: 0.0194 - acc: 0.9951 - ETA: 5s - loss: 0.0193 - acc: 0.9951 - ETA: 5s - loss: 0.0193 - acc: 0.9952 - ETA: 5s - loss: 0.0192 - acc: 0.9952 - ETA: 5s - loss: 0.0192 - acc: 0.9952 - ETA: 5s - loss: 0.0191 - acc: 0.9952 - ETA: 5s - loss: 0.0190 - acc: 0.9953 - ETA: 5s - loss: 0.0189 - acc: 0.9953 - ETA: 4s - loss: 0.0188 - acc: 0.9954 - ETA: 4s - loss: 0.0189 - acc: 0.9954 - ETA: 4s - loss: 0.0188 - acc: 0.9954 - ETA: 4s - loss: 0.0187 - acc: 0.9954 - ETA: 4s - loss: 0.0186 - acc: 0.9955 - ETA: 4s - loss: 0.0186 - acc: 0.9955 - ETA: 4s - loss: 0.0186 - acc: 0.9955 - ETA: 4s - loss: 0.0185 - acc: 0.9956 - ETA: 4s - loss: 0.0184 - acc: 0.9956 - ETA: 4s - loss: 0.0184 - acc: 0.9956 - ETA: 4s - loss: 0.0184 - acc: 0.9956 - ETA: 4s - loss: 0.0183 - acc: 0.9957 - ETA: 4s - loss: 0.0182 - acc: 0.9957 - ETA: 3s - loss: 0.0182 - acc: 0.9957 - ETA: 3s - loss: 0.0184 - acc: 0.9956 - ETA: 3s - loss: 0.0186 - acc: 0.9956 - ETA: 3s - loss: 0.0186 - acc: 0.9956 - ETA: 3s - loss: 0.0186 - acc: 0.9957 - ETA: 3s - loss: 0.0186 - acc: 0.9957 - ETA: 3s - loss: 0.0191 - acc: 0.9955 - ETA: 3s - loss: 0.0191 - acc: 0.9955 - ETA: 3s - loss: 0.0189 - acc: 0.9956 - ETA: 3s - loss: 0.0190 - acc: 0.9956 - ETA: 3s - loss: 0.0191 - acc: 0.9956 - ETA: 3s - loss: 0.0189 - acc: 0.9957 - ETA: 2s - loss: 0.0191 - acc: 0.9955 - ETA: 2s - loss: 0.0203 - acc: 0.9951 - ETA: 2s - loss: 0.0203 - acc: 0.9952 - ETA: 2s - loss: 0.0202 - acc: 0.9952 - ETA: 2s - loss: 0.0202 - acc: 0.9952 - ETA: 2s - loss: 0.0201 - acc: 0.9953 - ETA: 2s - loss: 0.0200 - acc: 0.9953 - ETA: 2s - loss: 0.0199 - acc: 0.9953 - ETA: 2s - loss: 0.0198 - acc: 0.9954 - ETA: 2s - loss: 0.0197 - acc: 0.9954 - ETA: 2s - loss: 0.0197 - acc: 0.9954 - ETA: 2s - loss: 0.0200 - acc: 0.9951 - ETA: 2s - loss: 0.0199 - acc: 0.9951 - ETA: 2s - loss: 0.0198 - acc: 0.9951 - ETA: 1s - loss: 0.0197 - acc: 0.9952 - ETA: 1s - loss: 0.0200 - acc: 0.9950 - ETA: 1s - loss: 0.0200 - acc: 0.9951 - ETA: 1s - loss: 0.0199 - acc: 0.9951 - ETA: 1s - loss: 0.0198 - acc: 0.9951 - ETA: 1s - loss: 0.0198 - acc: 0.9951 - ETA: 1s - loss: 0.0198 - acc: 0.9952 - ETA: 1s - loss: 0.0199 - acc: 0.9950 - ETA: 1s - loss: 0.0199 - acc: 0.9950 - ETA: 1s - loss: 0.0198 - acc: 0.9951 - ETA: 1s - loss: 0.0197 - acc: 0.9951 - ETA: 1s - loss: 0.0196 - acc: 0.9951 - ETA: 0s - loss: 0.0199 - acc: 0.9950 - ETA: 0s - loss: 0.0199 - acc: 0.9949 - ETA: 0s - loss: 0.0198 - acc: 0.9949 - ETA: 0s - loss: 0.0198 - acc: 0.9949 - ETA: 0s - loss: 0.0211 - acc: 0.9948 - ETA: 0s - loss: 0.0210 - acc: 0.9948 - ETA: 0s - loss: 0.0210 - acc: 0.9948 - ETA: 0s - loss: 0.0209 - acc: 0.9948 - ETA: 0s - loss: 0.0210 - acc: 0.9949 - ETA: 0s - loss: 0.0211 - acc: 0.9949 - ETA: 0s - loss: 0.0210 - acc: 0.9949 - ETA: 0s - loss: 0.0213 - acc: 0.9948 - ETA: 0s - loss: 0.0213 - acc: 0.9948 - ETA: 0s - loss: 0.0213 - acc: 0.9948 - ETA: 0s - loss: 0.0214 - acc: 0.9947 - ETA: 0s - loss: 0.0213 - acc: 0.9947 - ETA: 0s - loss: 0.0213 - acc: 0.9947Epoch 00010: val_loss did not improve
6680/6680 [==============================] - 14s - loss: 0.0215 - acc: 0.9946 - val_loss: 0.7336 - val_acc: 0.8228
Epoch 12/20
6660/6680 [============================>.] - ETA: 9s - loss: 7.0424e-04 - acc: 1.0000 - ETA: 9s - loss: 0.0033 - acc: 1.0000     - ETA: 11s - loss: 0.0565 - acc: 0.9875 - ETA: 10s - loss: 0.0410 - acc: 0.9917 - ETA: 11s - loss: 0.0356 - acc: 0.9929 - ETA: 12s - loss: 0.0315 - acc: 0.9937 - ETA: 11s - loss: 0.0266 - acc: 0.9950 - ETA: 11s - loss: 0.0228 - acc: 0.9958 - ETA: 11s - loss: 0.0234 - acc: 0.9962 - ETA: 12s - loss: 0.0408 - acc: 0.9929 - ETA: 11s - loss: 0.0363 - acc: 0.9937 - ETA: 12s - loss: 0.0351 - acc: 0.9941 - ETA: 11s - loss: 0.0339 - acc: 0.9921 - ETA: 11s - loss: 0.0323 - acc: 0.9925 - ETA: 11s - loss: 0.0294 - acc: 0.9932 - ETA: 11s - loss: 0.0286 - acc: 0.9935 - ETA: 11s - loss: 0.0299 - acc: 0.9920 - ETA: 11s - loss: 0.0278 - acc: 0.9926 - ETA: 11s - loss: 0.0283 - acc: 0.9929 - ETA: 11s - loss: 0.0272 - acc: 0.9933 - ETA: 11s - loss: 0.0257 - acc: 0.9937 - ETA: 11s - loss: 0.0252 - acc: 0.9939 - ETA: 11s - loss: 0.0242 - acc: 0.9943 - ETA: 10s - loss: 0.0233 - acc: 0.9946 - ETA: 10s - loss: 0.0227 - acc: 0.9947 - ETA: 10s - loss: 0.0217 - acc: 0.9950 - ETA: 10s - loss: 0.0207 - acc: 0.9952 - ETA: 10s - loss: 0.0206 - acc: 0.9955 - ETA: 10s - loss: 0.0206 - acc: 0.9956 - ETA: 10s - loss: 0.0202 - acc: 0.9957 - ETA: 10s - loss: 0.0195 - acc: 0.9958 - ETA: 10s - loss: 0.0209 - acc: 0.9950 - ETA: 10s - loss: 0.0202 - acc: 0.9952 - ETA: 10s - loss: 0.0196 - acc: 0.9954 - ETA: 10s - loss: 0.0190 - acc: 0.9955 - ETA: 10s - loss: 0.0186 - acc: 0.9957 - ETA: 10s - loss: 0.0195 - acc: 0.9950 - ETA: 9s - loss: 0.0191 - acc: 0.9952  - ETA: 9s - loss: 0.0186 - acc: 0.9953 - ETA: 9s - loss: 0.0187 - acc: 0.9947 - ETA: 9s - loss: 0.0185 - acc: 0.9948 - ETA: 9s - loss: 0.0182 - acc: 0.9949 - ETA: 9s - loss: 0.0178 - acc: 0.9950 - ETA: 9s - loss: 0.0175 - acc: 0.9951 - ETA: 9s - loss: 0.0174 - acc: 0.9953 - ETA: 9s - loss: 0.0169 - acc: 0.9954 - ETA: 9s - loss: 0.0166 - acc: 0.9955 - ETA: 9s - loss: 0.0162 - acc: 0.9956 - ETA: 9s - loss: 0.0164 - acc: 0.9957 - ETA: 9s - loss: 0.0167 - acc: 0.9958 - ETA: 9s - loss: 0.0164 - acc: 0.9959 - ETA: 8s - loss: 0.0163 - acc: 0.9960 - ETA: 8s - loss: 0.0161 - acc: 0.9961 - ETA: 8s - loss: 0.0159 - acc: 0.9962 - ETA: 8s - loss: 0.0157 - acc: 0.9962 - ETA: 8s - loss: 0.0158 - acc: 0.9958 - ETA: 8s - loss: 0.0157 - acc: 0.9958 - ETA: 8s - loss: 0.0156 - acc: 0.9959 - ETA: 8s - loss: 0.0155 - acc: 0.9959 - ETA: 8s - loss: 0.0155 - acc: 0.9960 - ETA: 8s - loss: 0.0153 - acc: 0.9960 - ETA: 8s - loss: 0.0151 - acc: 0.9961 - ETA: 8s - loss: 0.0150 - acc: 0.9962 - ETA: 8s - loss: 0.0153 - acc: 0.9962 - ETA: 8s - loss: 0.0150 - acc: 0.9963 - ETA: 8s - loss: 0.0149 - acc: 0.9964 - ETA: 8s - loss: 0.0148 - acc: 0.9964 - ETA: 8s - loss: 0.0147 - acc: 0.9964 - ETA: 8s - loss: 0.0147 - acc: 0.9965 - ETA: 8s - loss: 0.0148 - acc: 0.9965 - ETA: 8s - loss: 0.0147 - acc: 0.9965 - ETA: 8s - loss: 0.0146 - acc: 0.9966 - ETA: 8s - loss: 0.0145 - acc: 0.9966 - ETA: 7s - loss: 0.0143 - acc: 0.9967 - ETA: 7s - loss: 0.0160 - acc: 0.9963 - ETA: 7s - loss: 0.0162 - acc: 0.9959 - ETA: 7s - loss: 0.0160 - acc: 0.9960 - ETA: 7s - loss: 0.0162 - acc: 0.9957 - ETA: 7s - loss: 0.0161 - acc: 0.9957 - ETA: 7s - loss: 0.0159 - acc: 0.9958 - ETA: 7s - loss: 0.0158 - acc: 0.9958 - ETA: 7s - loss: 0.0159 - acc: 0.9959 - ETA: 7s - loss: 0.0157 - acc: 0.9959 - ETA: 7s - loss: 0.0157 - acc: 0.9960 - ETA: 7s - loss: 0.0155 - acc: 0.9960 - ETA: 7s - loss: 0.0155 - acc: 0.9960 - ETA: 7s - loss: 0.0153 - acc: 0.9961 - ETA: 7s - loss: 0.0152 - acc: 0.9962 - ETA: 7s - loss: 0.0151 - acc: 0.9962 - ETA: 6s - loss: 0.0153 - acc: 0.9962 - ETA: 6s - loss: 0.0154 - acc: 0.9963 - ETA: 6s - loss: 0.0153 - acc: 0.9963 - ETA: 6s - loss: 0.0153 - acc: 0.9964 - ETA: 6s - loss: 0.0151 - acc: 0.9964 - ETA: 6s - loss: 0.0151 - acc: 0.9965 - ETA: 6s - loss: 0.0150 - acc: 0.9965 - ETA: 6s - loss: 0.0158 - acc: 0.9962 - ETA: 6s - loss: 0.0156 - acc: 0.9962 - ETA: 6s - loss: 0.0155 - acc: 0.9963 - ETA: 6s - loss: 0.0158 - acc: 0.9960 - ETA: 6s - loss: 0.0157 - acc: 0.9961 - ETA: 6s - loss: 0.0156 - acc: 0.9961 - ETA: 6s - loss: 0.0156 - acc: 0.9961 - ETA: 6s - loss: 0.0155 - acc: 0.9962 - ETA: 6s - loss: 0.0154 - acc: 0.9962 - ETA: 6s - loss: 0.0156 - acc: 0.9959 - ETA: 5s - loss: 0.0154 - acc: 0.9960 - ETA: 5s - loss: 0.0153 - acc: 0.9960 - ETA: 5s - loss: 0.0152 - acc: 0.9960 - ETA: 5s - loss: 0.0162 - acc: 0.9958 - ETA: 5s - loss: 0.0161 - acc: 0.9959 - ETA: 5s - loss: 0.0160 - acc: 0.9959 - ETA: 5s - loss: 0.0159 - acc: 0.9959 - ETA: 5s - loss: 0.0159 - acc: 0.9960 - ETA: 5s - loss: 0.0159 - acc: 0.9960 - ETA: 5s - loss: 0.0158 - acc: 0.9960 - ETA: 5s - loss: 0.0157 - acc: 0.9961 - ETA: 5s - loss: 0.0160 - acc: 0.9959 - ETA: 5s - loss: 0.0160 - acc: 0.9959 - ETA: 5s - loss: 0.0162 - acc: 0.9957 - ETA: 5s - loss: 0.0160 - acc: 0.9957 - ETA: 4s - loss: 0.0160 - acc: 0.9958 - ETA: 4s - loss: 0.0159 - acc: 0.9958 - ETA: 4s - loss: 0.0159 - acc: 0.9959 - ETA: 4s - loss: 0.0159 - acc: 0.9959 - ETA: 4s - loss: 0.0159 - acc: 0.9959 - ETA: 4s - loss: 0.0158 - acc: 0.9960 - ETA: 4s - loss: 0.0159 - acc: 0.9958 - ETA: 4s - loss: 0.0159 - acc: 0.9958 - ETA: 4s - loss: 0.0158 - acc: 0.9958 - ETA: 4s - loss: 0.0158 - acc: 0.9959 - ETA: 4s - loss: 0.0157 - acc: 0.9959 - ETA: 4s - loss: 0.0157 - acc: 0.9959 - ETA: 4s - loss: 0.0156 - acc: 0.9959 - ETA: 4s - loss: 0.0157 - acc: 0.9960 - ETA: 4s - loss: 0.0157 - acc: 0.9960 - ETA: 4s - loss: 0.0156 - acc: 0.9960 - ETA: 3s - loss: 0.0156 - acc: 0.9961 - ETA: 3s - loss: 0.0155 - acc: 0.9961 - ETA: 3s - loss: 0.0155 - acc: 0.9961 - ETA: 3s - loss: 0.0168 - acc: 0.9957 - ETA: 3s - loss: 0.0167 - acc: 0.9957 - ETA: 3s - loss: 0.0167 - acc: 0.9957 - ETA: 3s - loss: 0.0166 - acc: 0.9958 - ETA: 3s - loss: 0.0165 - acc: 0.9958 - ETA: 3s - loss: 0.0165 - acc: 0.9958 - ETA: 3s - loss: 0.0164 - acc: 0.9958 - ETA: 3s - loss: 0.0165 - acc: 0.9959 - ETA: 3s - loss: 0.0164 - acc: 0.9959 - ETA: 3s - loss: 0.0163 - acc: 0.9959 - ETA: 3s - loss: 0.0163 - acc: 0.9959 - ETA: 3s - loss: 0.0162 - acc: 0.9960 - ETA: 3s - loss: 0.0163 - acc: 0.9960 - ETA: 3s - loss: 0.0162 - acc: 0.9960 - ETA: 2s - loss: 0.0161 - acc: 0.9961 - ETA: 2s - loss: 0.0160 - acc: 0.9961 - ETA: 2s - loss: 0.0160 - acc: 0.9961 - ETA: 2s - loss: 0.0161 - acc: 0.9959 - ETA: 2s - loss: 0.0161 - acc: 0.9960 - ETA: 2s - loss: 0.0161 - acc: 0.9960 - ETA: 2s - loss: 0.0161 - acc: 0.9958 - ETA: 2s - loss: 0.0161 - acc: 0.9959 - ETA: 2s - loss: 0.0160 - acc: 0.9959 - ETA: 2s - loss: 0.0160 - acc: 0.9959 - ETA: 2s - loss: 0.0159 - acc: 0.9959 - ETA: 2s - loss: 0.0159 - acc: 0.9960 - ETA: 2s - loss: 0.0159 - acc: 0.9960 - ETA: 2s - loss: 0.0159 - acc: 0.9960 - ETA: 2s - loss: 0.0159 - acc: 0.9960 - ETA: 2s - loss: 0.0158 - acc: 0.9961 - ETA: 1s - loss: 0.0158 - acc: 0.9961 - ETA: 1s - loss: 0.0157 - acc: 0.9961 - ETA: 1s - loss: 0.0157 - acc: 0.9961 - ETA: 1s - loss: 0.0158 - acc: 0.9960 - ETA: 1s - loss: 0.0157 - acc: 0.9960 - ETA: 1s - loss: 0.0156 - acc: 0.9960 - ETA: 1s - loss: 0.0157 - acc: 0.9959 - ETA: 1s - loss: 0.0157 - acc: 0.9959 - ETA: 1s - loss: 0.0156 - acc: 0.9959 - ETA: 1s - loss: 0.0156 - acc: 0.9960 - ETA: 1s - loss: 0.0156 - acc: 0.9960 - ETA: 1s - loss: 0.0155 - acc: 0.9960 - ETA: 1s - loss: 0.0155 - acc: 0.9960 - ETA: 1s - loss: 0.0155 - acc: 0.9960 - ETA: 1s - loss: 0.0154 - acc: 0.9961 - ETA: 1s - loss: 0.0154 - acc: 0.9961 - ETA: 0s - loss: 0.0156 - acc: 0.9959 - ETA: 0s - loss: 0.0155 - acc: 0.9960 - ETA: 0s - loss: 0.0155 - acc: 0.9960 - ETA: 0s - loss: 0.0154 - acc: 0.9960 - ETA: 0s - loss: 0.0154 - acc: 0.9960 - ETA: 0s - loss: 0.0153 - acc: 0.9961 - ETA: 0s - loss: 0.0153 - acc: 0.9961 - ETA: 0s - loss: 0.0153 - acc: 0.9961 - ETA: 0s - loss: 0.0153 - acc: 0.9961 - ETA: 0s - loss: 0.0152 - acc: 0.9961 - ETA: 0s - loss: 0.0152 - acc: 0.9962 - ETA: 0s - loss: 0.0151 - acc: 0.9962 - ETA: 0s - loss: 0.0152 - acc: 0.9962 - ETA: 0s - loss: 0.0152 - acc: 0.9962 - ETA: 0s - loss: 0.0152 - acc: 0.9962 - ETA: 0s - loss: 0.0152 - acc: 0.9962Epoch 00011: val_loss did not improve
6680/6680 [==============================] - 12s - loss: 0.0151 - acc: 0.9963 - val_loss: 0.7967 - val_acc: 0.8180
Epoch 13/20
6640/6680 [============================>.] - ETA: 9s - loss: 0.0318 - acc: 1.0000 - ETA: 11s - loss: 0.0787 - acc: 0.9667 - ETA: 12s - loss: 0.0653 - acc: 0.9750 - ETA: 13s - loss: 0.0534 - acc: 0.9800 - ETA: 12s - loss: 0.0395 - acc: 0.9857 - ETA: 12s - loss: 0.0316 - acc: 0.9889 - ETA: 12s - loss: 0.0273 - acc: 0.9909 - ETA: 11s - loss: 0.0360 - acc: 0.9846 - ETA: 11s - loss: 0.0320 - acc: 0.9867 - ETA: 11s - loss: 0.0305 - acc: 0.9875 - ETA: 12s - loss: 0.0287 - acc: 0.9882 - ETA: 12s - loss: 0.0276 - acc: 0.9889 - ETA: 12s - loss: 0.0262 - acc: 0.9895 - ETA: 12s - loss: 0.0254 - acc: 0.9900 - ETA: 12s - loss: 0.0244 - acc: 0.9905 - ETA: 12s - loss: 0.0235 - acc: 0.9909 - ETA: 12s - loss: 0.0218 - acc: 0.9917 - ETA: 12s - loss: 0.0210 - acc: 0.9920 - ETA: 12s - loss: 0.0202 - acc: 0.9923 - ETA: 12s - loss: 0.0195 - acc: 0.9926 - ETA: 12s - loss: 0.0196 - acc: 0.9929 - ETA: 12s - loss: 0.0192 - acc: 0.9931 - ETA: 12s - loss: 0.0184 - acc: 0.9935 - ETA: 12s - loss: 0.0179 - acc: 0.9937 - ETA: 12s - loss: 0.0220 - acc: 0.9926 - ETA: 12s - loss: 0.0210 - acc: 0.9931 - ETA: 12s - loss: 0.0206 - acc: 0.9932 - ETA: 12s - loss: 0.0197 - acc: 0.9936 - ETA: 11s - loss: 0.0188 - acc: 0.9939 - ETA: 11s - loss: 0.0180 - acc: 0.9942 - ETA: 11s - loss: 0.0293 - acc: 0.9933 - ETA: 11s - loss: 0.0283 - acc: 0.9936 - ETA: 11s - loss: 0.0277 - acc: 0.9937 - ETA: 11s - loss: 0.0267 - acc: 0.9940 - ETA: 11s - loss: 0.0257 - acc: 0.9942 - ETA: 10s - loss: 0.0249 - acc: 0.9944 - ETA: 10s - loss: 0.0240 - acc: 0.9946 - ETA: 10s - loss: 0.0237 - acc: 0.9947 - ETA: 10s - loss: 0.0234 - acc: 0.9948 - ETA: 10s - loss: 0.0230 - acc: 0.9950 - ETA: 10s - loss: 0.0228 - acc: 0.9951 - ETA: 10s - loss: 0.0224 - acc: 0.9952 - ETA: 10s - loss: 0.0217 - acc: 0.9954 - ETA: 10s - loss: 0.0212 - acc: 0.9955 - ETA: 10s - loss: 0.0206 - acc: 0.9957 - ETA: 10s - loss: 0.0204 - acc: 0.9958 - ETA: 10s - loss: 0.0201 - acc: 0.9958 - ETA: 10s - loss: 0.0199 - acc: 0.9959 - ETA: 10s - loss: 0.0211 - acc: 0.9953 - ETA: 9s - loss: 0.0207 - acc: 0.9955  - ETA: 9s - loss: 0.0203 - acc: 0.9956 - ETA: 9s - loss: 0.0201 - acc: 0.9956 - ETA: 9s - loss: 0.0197 - acc: 0.9957 - ETA: 9s - loss: 0.0195 - acc: 0.9958 - ETA: 9s - loss: 0.0194 - acc: 0.9958 - ETA: 9s - loss: 0.0190 - acc: 0.9959 - ETA: 9s - loss: 0.0192 - acc: 0.9954 - ETA: 9s - loss: 0.0188 - acc: 0.9955 - ETA: 9s - loss: 0.0185 - acc: 0.9956 - ETA: 9s - loss: 0.0182 - acc: 0.9957 - ETA: 9s - loss: 0.0181 - acc: 0.9957 - ETA: 9s - loss: 0.0183 - acc: 0.9953 - ETA: 9s - loss: 0.0181 - acc: 0.9954 - ETA: 8s - loss: 0.0178 - acc: 0.9955 - ETA: 8s - loss: 0.0179 - acc: 0.9955 - ETA: 8s - loss: 0.0177 - acc: 0.9956 - ETA: 8s - loss: 0.0175 - acc: 0.9957 - ETA: 8s - loss: 0.0172 - acc: 0.9958 - ETA: 8s - loss: 0.0170 - acc: 0.9958 - ETA: 8s - loss: 0.0167 - acc: 0.9959 - ETA: 8s - loss: 0.0166 - acc: 0.9960 - ETA: 8s - loss: 0.0164 - acc: 0.9960 - ETA: 8s - loss: 0.0163 - acc: 0.9961 - ETA: 8s - loss: 0.0161 - acc: 0.9961 - ETA: 8s - loss: 0.0160 - acc: 0.9962 - ETA: 8s - loss: 0.0161 - acc: 0.9962 - ETA: 8s - loss: 0.0160 - acc: 0.9962 - ETA: 8s - loss: 0.0158 - acc: 0.9963 - ETA: 7s - loss: 0.0156 - acc: 0.9964 - ETA: 7s - loss: 0.0154 - acc: 0.9964 - ETA: 7s - loss: 0.0153 - acc: 0.9964 - ETA: 7s - loss: 0.0152 - acc: 0.9965 - ETA: 7s - loss: 0.0151 - acc: 0.9965 - ETA: 7s - loss: 0.0149 - acc: 0.9965 - ETA: 7s - loss: 0.0148 - acc: 0.9966 - ETA: 7s - loss: 0.0148 - acc: 0.9966 - ETA: 7s - loss: 0.0146 - acc: 0.9967 - ETA: 7s - loss: 0.0144 - acc: 0.9967 - ETA: 7s - loss: 0.0144 - acc: 0.9967 - ETA: 7s - loss: 0.0142 - acc: 0.9968 - ETA: 7s - loss: 0.0141 - acc: 0.9968 - ETA: 7s - loss: 0.0140 - acc: 0.9969 - ETA: 7s - loss: 0.0139 - acc: 0.9969 - ETA: 7s - loss: 0.0138 - acc: 0.9969 - ETA: 7s - loss: 0.0137 - acc: 0.9970 - ETA: 6s - loss: 0.0136 - acc: 0.9970 - ETA: 6s - loss: 0.0135 - acc: 0.9970 - ETA: 6s - loss: 0.0138 - acc: 0.9967 - ETA: 6s - loss: 0.0137 - acc: 0.9968 - ETA: 6s - loss: 0.0138 - acc: 0.9968 - ETA: 6s - loss: 0.0137 - acc: 0.9969 - ETA: 6s - loss: 0.0136 - acc: 0.9969 - ETA: 6s - loss: 0.0135 - acc: 0.9969 - ETA: 6s - loss: 0.0135 - acc: 0.9970 - ETA: 6s - loss: 0.0134 - acc: 0.9970 - ETA: 6s - loss: 0.0133 - acc: 0.9970 - ETA: 6s - loss: 0.0134 - acc: 0.9970 - ETA: 6s - loss: 0.0135 - acc: 0.9971 - ETA: 6s - loss: 0.0134 - acc: 0.9971 - ETA: 6s - loss: 0.0134 - acc: 0.9971 - ETA: 5s - loss: 0.0134 - acc: 0.9971 - ETA: 5s - loss: 0.0133 - acc: 0.9972 - ETA: 5s - loss: 0.0132 - acc: 0.9972 - ETA: 5s - loss: 0.0135 - acc: 0.9969 - ETA: 5s - loss: 0.0135 - acc: 0.9970 - ETA: 5s - loss: 0.0135 - acc: 0.9970 - ETA: 5s - loss: 0.0135 - acc: 0.9970 - ETA: 5s - loss: 0.0136 - acc: 0.9968 - ETA: 5s - loss: 0.0135 - acc: 0.9968 - ETA: 5s - loss: 0.0135 - acc: 0.9968 - ETA: 5s - loss: 0.0134 - acc: 0.9968 - ETA: 5s - loss: 0.0133 - acc: 0.9969 - ETA: 5s - loss: 0.0134 - acc: 0.9966 - ETA: 5s - loss: 0.0133 - acc: 0.9967 - ETA: 5s - loss: 0.0132 - acc: 0.9967 - ETA: 5s - loss: 0.0134 - acc: 0.9965 - ETA: 4s - loss: 0.0134 - acc: 0.9965 - ETA: 4s - loss: 0.0134 - acc: 0.9965 - ETA: 4s - loss: 0.0133 - acc: 0.9966 - ETA: 4s - loss: 0.0132 - acc: 0.9966 - ETA: 4s - loss: 0.0131 - acc: 0.9966 - ETA: 4s - loss: 0.0130 - acc: 0.9967 - ETA: 4s - loss: 0.0131 - acc: 0.9967 - ETA: 4s - loss: 0.0132 - acc: 0.9967 - ETA: 4s - loss: 0.0135 - acc: 0.9965 - ETA: 4s - loss: 0.0135 - acc: 0.9965 - ETA: 4s - loss: 0.0134 - acc: 0.9965 - ETA: 4s - loss: 0.0134 - acc: 0.9965 - ETA: 4s - loss: 0.0133 - acc: 0.9965 - ETA: 4s - loss: 0.0132 - acc: 0.9966 - ETA: 4s - loss: 0.0132 - acc: 0.9966 - ETA: 4s - loss: 0.0131 - acc: 0.9966 - ETA: 4s - loss: 0.0130 - acc: 0.9967 - ETA: 4s - loss: 0.0129 - acc: 0.9967 - ETA: 4s - loss: 0.0129 - acc: 0.9967 - ETA: 3s - loss: 0.0128 - acc: 0.9967 - ETA: 3s - loss: 0.0128 - acc: 0.9968 - ETA: 3s - loss: 0.0128 - acc: 0.9968 - ETA: 3s - loss: 0.0127 - acc: 0.9968 - ETA: 3s - loss: 0.0126 - acc: 0.9968 - ETA: 3s - loss: 0.0126 - acc: 0.9968 - ETA: 3s - loss: 0.0125 - acc: 0.9969 - ETA: 3s - loss: 0.0124 - acc: 0.9969 - ETA: 3s - loss: 0.0123 - acc: 0.9969 - ETA: 3s - loss: 0.0123 - acc: 0.9969 - ETA: 3s - loss: 0.0123 - acc: 0.9969 - ETA: 3s - loss: 0.0123 - acc: 0.9970 - ETA: 3s - loss: 0.0122 - acc: 0.9970 - ETA: 3s - loss: 0.0122 - acc: 0.9970 - ETA: 3s - loss: 0.0121 - acc: 0.9970 - ETA: 3s - loss: 0.0121 - acc: 0.9970 - ETA: 2s - loss: 0.0125 - acc: 0.9969 - ETA: 2s - loss: 0.0124 - acc: 0.9969 - ETA: 2s - loss: 0.0124 - acc: 0.9969 - ETA: 2s - loss: 0.0123 - acc: 0.9969 - ETA: 2s - loss: 0.0125 - acc: 0.9967 - ETA: 2s - loss: 0.0124 - acc: 0.9968 - ETA: 2s - loss: 0.0124 - acc: 0.9968 - ETA: 2s - loss: 0.0127 - acc: 0.9966 - ETA: 2s - loss: 0.0127 - acc: 0.9966 - ETA: 2s - loss: 0.0128 - acc: 0.9966 - ETA: 2s - loss: 0.0128 - acc: 0.9967 - ETA: 2s - loss: 0.0127 - acc: 0.9967 - ETA: 2s - loss: 0.0127 - acc: 0.9967 - ETA: 2s - loss: 0.0126 - acc: 0.9967 - ETA: 2s - loss: 0.0127 - acc: 0.9967 - ETA: 2s - loss: 0.0126 - acc: 0.9968 - ETA: 2s - loss: 0.0126 - acc: 0.9968 - ETA: 2s - loss: 0.0128 - acc: 0.9966 - ETA: 1s - loss: 0.0127 - acc: 0.9966 - ETA: 1s - loss: 0.0127 - acc: 0.9966 - ETA: 1s - loss: 0.0126 - acc: 0.9967 - ETA: 1s - loss: 0.0126 - acc: 0.9967 - ETA: 1s - loss: 0.0125 - acc: 0.9967 - ETA: 1s - loss: 0.0125 - acc: 0.9967 - ETA: 1s - loss: 0.0125 - acc: 0.9967 - ETA: 1s - loss: 0.0125 - acc: 0.9968 - ETA: 1s - loss: 0.0126 - acc: 0.9966 - ETA: 1s - loss: 0.0125 - acc: 0.9966 - ETA: 1s - loss: 0.0126 - acc: 0.9966 - ETA: 1s - loss: 0.0125 - acc: 0.9967 - ETA: 1s - loss: 0.0125 - acc: 0.9967 - ETA: 1s - loss: 0.0125 - acc: 0.9967 - ETA: 1s - loss: 0.0125 - acc: 0.9967 - ETA: 1s - loss: 0.0124 - acc: 0.9967 - ETA: 1s - loss: 0.0124 - acc: 0.9967 - ETA: 0s - loss: 0.0124 - acc: 0.9968 - ETA: 0s - loss: 0.0126 - acc: 0.9966 - ETA: 0s - loss: 0.0126 - acc: 0.9966 - ETA: 0s - loss: 0.0126 - acc: 0.9966 - ETA: 0s - loss: 0.0126 - acc: 0.9967 - ETA: 0s - loss: 0.0126 - acc: 0.9967 - ETA: 0s - loss: 0.0126 - acc: 0.9967 - ETA: 0s - loss: 0.0126 - acc: 0.9967 - ETA: 0s - loss: 0.0125 - acc: 0.9967 - ETA: 0s - loss: 0.0126 - acc: 0.9967 - ETA: 0s - loss: 0.0135 - acc: 0.9966 - ETA: 0s - loss: 0.0135 - acc: 0.9966 - ETA: 0s - loss: 0.0135 - acc: 0.9966 - ETA: 0s - loss: 0.0135 - acc: 0.9966 - ETA: 0s - loss: 0.0135 - acc: 0.9966 - ETA: 0s - loss: 0.0135 - acc: 0.9967 - ETA: 0s - loss: 0.0135 - acc: 0.9967Epoch 00012: val_loss did not improve
6680/6680 [==============================] - 12s - loss: 0.0139 - acc: 0.9964 - val_loss: 0.7842 - val_acc: 0.8287
Epoch 14/20
6640/6680 [============================>.] - ETA: 6s - loss: 0.0070 - acc: 1.0000 - ETA: 9s - loss: 0.0037 - acc: 1.0000 - ETA: 10s - loss: 0.0031 - acc: 1.0000 - ETA: 10s - loss: 0.0027 - acc: 1.0000 - ETA: 11s - loss: 0.0025 - acc: 1.0000 - ETA: 10s - loss: 0.0023 - acc: 1.0000 - ETA: 11s - loss: 0.0022 - acc: 1.0000 - ETA: 11s - loss: 0.0021 - acc: 1.0000 - ETA: 11s - loss: 0.0020 - acc: 1.0000 - ETA: 11s - loss: 0.0018 - acc: 1.0000 - ETA: 11s - loss: 0.0017 - acc: 1.0000 - ETA: 11s - loss: 0.0016 - acc: 1.0000 - ETA: 11s - loss: 0.0016 - acc: 1.0000 - ETA: 11s - loss: 0.0016 - acc: 1.0000 - ETA: 11s - loss: 0.0018 - acc: 1.0000 - ETA: 10s - loss: 0.0017 - acc: 1.0000 - ETA: 11s - loss: 0.0018 - acc: 1.0000 - ETA: 11s - loss: 0.0018 - acc: 1.0000 - ETA: 10s - loss: 0.0019 - acc: 1.0000 - ETA: 11s - loss: 0.0019 - acc: 1.0000 - ETA: 10s - loss: 0.0019 - acc: 1.0000 - ETA: 10s - loss: 0.0019 - acc: 1.0000 - ETA: 10s - loss: 0.0019 - acc: 1.0000 - ETA: 10s - loss: 0.0021 - acc: 1.0000 - ETA: 10s - loss: 0.0022 - acc: 1.0000 - ETA: 10s - loss: 0.0022 - acc: 1.0000 - ETA: 10s - loss: 0.0027 - acc: 1.0000 - ETA: 10s - loss: 0.0027 - acc: 1.0000 - ETA: 10s - loss: 0.0027 - acc: 1.0000 - ETA: 10s - loss: 0.0026 - acc: 1.0000 - ETA: 10s - loss: 0.0026 - acc: 1.0000 - ETA: 10s - loss: 0.0026 - acc: 1.0000 - ETA: 10s - loss: 0.0026 - acc: 1.0000 - ETA: 10s - loss: 0.0026 - acc: 1.0000 - ETA: 10s - loss: 0.0026 - acc: 1.0000 - ETA: 10s - loss: 0.0026 - acc: 1.0000 - ETA: 10s - loss: 0.0026 - acc: 1.0000 - ETA: 10s - loss: 0.0033 - acc: 1.0000 - ETA: 10s - loss: 0.0032 - acc: 1.0000 - ETA: 10s - loss: 0.0033 - acc: 1.0000 - ETA: 10s - loss: 0.0032 - acc: 1.0000 - ETA: 10s - loss: 0.0039 - acc: 0.9992 - ETA: 10s - loss: 0.0039 - acc: 0.9992 - ETA: 10s - loss: 0.0042 - acc: 0.9993 - ETA: 10s - loss: 0.0050 - acc: 0.9985 - ETA: 10s - loss: 0.0052 - acc: 0.9986 - ETA: 10s - loss: 0.0052 - acc: 0.9986 - ETA: 10s - loss: 0.0054 - acc: 0.9986 - ETA: 10s - loss: 0.0053 - acc: 0.9986 - ETA: 9s - loss: 0.0052 - acc: 0.9987  - ETA: 9s - loss: 0.0052 - acc: 0.9987 - ETA: 9s - loss: 0.0052 - acc: 0.9987 - ETA: 9s - loss: 0.0051 - acc: 0.9987 - ETA: 9s - loss: 0.0050 - acc: 0.9988 - ETA: 9s - loss: 0.0058 - acc: 0.9982 - ETA: 9s - loss: 0.0058 - acc: 0.9982 - ETA: 9s - loss: 0.0057 - acc: 0.9983 - ETA: 9s - loss: 0.0059 - acc: 0.9983 - ETA: 9s - loss: 0.0059 - acc: 0.9983 - ETA: 9s - loss: 0.0058 - acc: 0.9983 - ETA: 9s - loss: 0.0057 - acc: 0.9984 - ETA: 9s - loss: 0.0059 - acc: 0.9984 - ETA: 9s - loss: 0.0059 - acc: 0.9984 - ETA: 9s - loss: 0.0094 - acc: 0.9979 - ETA: 8s - loss: 0.0092 - acc: 0.9980 - ETA: 8s - loss: 0.0091 - acc: 0.9980 - ETA: 8s - loss: 0.0090 - acc: 0.9980 - ETA: 8s - loss: 0.0090 - acc: 0.9980 - ETA: 8s - loss: 0.0090 - acc: 0.9981 - ETA: 8s - loss: 0.0090 - acc: 0.9981 - ETA: 8s - loss: 0.0091 - acc: 0.9981 - ETA: 8s - loss: 0.0090 - acc: 0.9981 - ETA: 8s - loss: 0.0090 - acc: 0.9982 - ETA: 8s - loss: 0.0090 - acc: 0.9982 - ETA: 8s - loss: 0.0089 - acc: 0.9982 - ETA: 8s - loss: 0.0089 - acc: 0.9982 - ETA: 8s - loss: 0.0088 - acc: 0.9983 - ETA: 8s - loss: 0.0087 - acc: 0.9983 - ETA: 8s - loss: 0.0086 - acc: 0.9983 - ETA: 8s - loss: 0.0085 - acc: 0.9983 - ETA: 8s - loss: 0.0085 - acc: 0.9983 - ETA: 8s - loss: 0.0086 - acc: 0.9984 - ETA: 8s - loss: 0.0084 - acc: 0.9984 - ETA: 8s - loss: 0.0084 - acc: 0.9984 - ETA: 7s - loss: 0.0084 - acc: 0.9984 - ETA: 7s - loss: 0.0087 - acc: 0.9980 - ETA: 7s - loss: 0.0086 - acc: 0.9981 - ETA: 7s - loss: 0.0087 - acc: 0.9981 - ETA: 7s - loss: 0.0086 - acc: 0.9981 - ETA: 7s - loss: 0.0085 - acc: 0.9981 - ETA: 7s - loss: 0.0085 - acc: 0.9981 - ETA: 7s - loss: 0.0084 - acc: 0.9982 - ETA: 7s - loss: 0.0084 - acc: 0.9982 - ETA: 7s - loss: 0.0083 - acc: 0.9982 - ETA: 7s - loss: 0.0083 - acc: 0.9982 - ETA: 7s - loss: 0.0083 - acc: 0.9983 - ETA: 7s - loss: 0.0082 - acc: 0.9983 - ETA: 7s - loss: 0.0082 - acc: 0.9983 - ETA: 7s - loss: 0.0082 - acc: 0.9983 - ETA: 7s - loss: 0.0081 - acc: 0.9983 - ETA: 6s - loss: 0.0081 - acc: 0.9983 - ETA: 6s - loss: 0.0082 - acc: 0.9984 - ETA: 6s - loss: 0.0081 - acc: 0.9984 - ETA: 6s - loss: 0.0080 - acc: 0.9984 - ETA: 6s - loss: 0.0079 - acc: 0.9984 - ETA: 6s - loss: 0.0079 - acc: 0.9984 - ETA: 6s - loss: 0.0079 - acc: 0.9984 - ETA: 6s - loss: 0.0079 - acc: 0.9985 - ETA: 6s - loss: 0.0079 - acc: 0.9985 - ETA: 6s - loss: 0.0078 - acc: 0.9985 - ETA: 6s - loss: 0.0078 - acc: 0.9985 - ETA: 6s - loss: 0.0077 - acc: 0.9985 - ETA: 6s - loss: 0.0078 - acc: 0.9985 - ETA: 6s - loss: 0.0077 - acc: 0.9986 - ETA: 6s - loss: 0.0077 - acc: 0.9986 - ETA: 6s - loss: 0.0076 - acc: 0.9986 - ETA: 5s - loss: 0.0076 - acc: 0.9986 - ETA: 5s - loss: 0.0076 - acc: 0.9986 - ETA: 5s - loss: 0.0075 - acc: 0.9986 - ETA: 5s - loss: 0.0075 - acc: 0.9986 - ETA: 5s - loss: 0.0075 - acc: 0.9986 - ETA: 5s - loss: 0.0075 - acc: 0.9986 - ETA: 5s - loss: 0.0075 - acc: 0.9986 - ETA: 5s - loss: 0.0074 - acc: 0.9987 - ETA: 5s - loss: 0.0074 - acc: 0.9987 - ETA: 5s - loss: 0.0074 - acc: 0.9987 - ETA: 5s - loss: 0.0074 - acc: 0.9987 - ETA: 5s - loss: 0.0086 - acc: 0.9984 - ETA: 5s - loss: 0.0086 - acc: 0.9985 - ETA: 5s - loss: 0.0085 - acc: 0.9985 - ETA: 5s - loss: 0.0085 - acc: 0.9985 - ETA: 5s - loss: 0.0085 - acc: 0.9985 - ETA: 5s - loss: 0.0084 - acc: 0.9985 - ETA: 5s - loss: 0.0084 - acc: 0.9985 - ETA: 4s - loss: 0.0084 - acc: 0.9985 - ETA: 4s - loss: 0.0083 - acc: 0.9985 - ETA: 4s - loss: 0.0084 - acc: 0.9985 - ETA: 4s - loss: 0.0085 - acc: 0.9986 - ETA: 4s - loss: 0.0085 - acc: 0.9986 - ETA: 4s - loss: 0.0086 - acc: 0.9986 - ETA: 4s - loss: 0.0087 - acc: 0.9986 - ETA: 4s - loss: 0.0087 - acc: 0.9986 - ETA: 4s - loss: 0.0086 - acc: 0.9986 - ETA: 4s - loss: 0.0086 - acc: 0.9986 - ETA: 4s - loss: 0.0086 - acc: 0.9986 - ETA: 4s - loss: 0.0086 - acc: 0.9986 - ETA: 4s - loss: 0.0085 - acc: 0.9986 - ETA: 4s - loss: 0.0085 - acc: 0.9987 - ETA: 4s - loss: 0.0084 - acc: 0.9987 - ETA: 4s - loss: 0.0084 - acc: 0.9987 - ETA: 3s - loss: 0.0083 - acc: 0.9987 - ETA: 3s - loss: 0.0083 - acc: 0.9987 - ETA: 3s - loss: 0.0083 - acc: 0.9987 - ETA: 3s - loss: 0.0083 - acc: 0.9987 - ETA: 3s - loss: 0.0082 - acc: 0.9987 - ETA: 3s - loss: 0.0082 - acc: 0.9987 - ETA: 3s - loss: 0.0082 - acc: 0.9987 - ETA: 3s - loss: 0.0081 - acc: 0.9987 - ETA: 3s - loss: 0.0088 - acc: 0.9985 - ETA: 3s - loss: 0.0087 - acc: 0.9986 - ETA: 3s - loss: 0.0087 - acc: 0.9986 - ETA: 3s - loss: 0.0086 - acc: 0.9986 - ETA: 3s - loss: 0.0087 - acc: 0.9986 - ETA: 3s - loss: 0.0086 - acc: 0.9986 - ETA: 3s - loss: 0.0088 - acc: 0.9984 - ETA: 3s - loss: 0.0088 - acc: 0.9984 - ETA: 3s - loss: 0.0089 - acc: 0.9984 - ETA: 2s - loss: 0.0089 - acc: 0.9984 - ETA: 2s - loss: 0.0089 - acc: 0.9984 - ETA: 2s - loss: 0.0088 - acc: 0.9984 - ETA: 2s - loss: 0.0089 - acc: 0.9985 - ETA: 2s - loss: 0.0088 - acc: 0.9985 - ETA: 2s - loss: 0.0088 - acc: 0.9985 - ETA: 2s - loss: 0.0087 - acc: 0.9985 - ETA: 2s - loss: 0.0087 - acc: 0.9985 - ETA: 2s - loss: 0.0091 - acc: 0.9983 - ETA: 2s - loss: 0.0090 - acc: 0.9983 - ETA: 2s - loss: 0.0090 - acc: 0.9983 - ETA: 2s - loss: 0.0090 - acc: 0.9983 - ETA: 2s - loss: 0.0090 - acc: 0.9984 - ETA: 2s - loss: 0.0089 - acc: 0.9984 - ETA: 2s - loss: 0.0090 - acc: 0.9984 - ETA: 2s - loss: 0.0090 - acc: 0.9984 - ETA: 2s - loss: 0.0090 - acc: 0.9984 - ETA: 2s - loss: 0.0090 - acc: 0.9984 - ETA: 1s - loss: 0.0090 - acc: 0.9984 - ETA: 1s - loss: 0.0092 - acc: 0.9982 - ETA: 1s - loss: 0.0091 - acc: 0.9983 - ETA: 1s - loss: 0.0091 - acc: 0.9983 - ETA: 1s - loss: 0.0090 - acc: 0.9983 - ETA: 1s - loss: 0.0090 - acc: 0.9983 - ETA: 1s - loss: 0.0090 - acc: 0.9983 - ETA: 1s - loss: 0.0089 - acc: 0.9983 - ETA: 1s - loss: 0.0090 - acc: 0.9983 - ETA: 1s - loss: 0.0090 - acc: 0.9983 - ETA: 1s - loss: 0.0089 - acc: 0.9983 - ETA: 1s - loss: 0.0089 - acc: 0.9983 - ETA: 1s - loss: 0.0089 - acc: 0.9983 - ETA: 1s - loss: 0.0088 - acc: 0.9984 - ETA: 1s - loss: 0.0088 - acc: 0.9984 - ETA: 0s - loss: 0.0104 - acc: 0.9982 - ETA: 0s - loss: 0.0104 - acc: 0.9982 - ETA: 0s - loss: 0.0103 - acc: 0.9982 - ETA: 0s - loss: 0.0103 - acc: 0.9982 - ETA: 0s - loss: 0.0103 - acc: 0.9983 - ETA: 0s - loss: 0.0102 - acc: 0.9983 - ETA: 0s - loss: 0.0102 - acc: 0.9983 - ETA: 0s - loss: 0.0102 - acc: 0.9983 - ETA: 0s - loss: 0.0102 - acc: 0.9983 - ETA: 0s - loss: 0.0106 - acc: 0.9981 - ETA: 0s - loss: 0.0106 - acc: 0.9981 - ETA: 0s - loss: 0.0106 - acc: 0.9982 - ETA: 0s - loss: 0.0106 - acc: 0.9982 - ETA: 0s - loss: 0.0110 - acc: 0.9980 - ETA: 0s - loss: 0.0110 - acc: 0.9980 - ETA: 0s - loss: 0.0110 - acc: 0.9980 - ETA: 0s - loss: 0.0111 - acc: 0.9979Epoch 00013: val_loss did not improve
6680/6680 [==============================] - 12s - loss: 0.0111 - acc: 0.9979 - val_loss: 0.8207 - val_acc: 0.8275
Epoch 15/20
6640/6680 [============================>.] - ETA: 6s - loss: 3.4496e-04 - acc: 1.0000 - ETA: 9s - loss: 0.0052 - acc: 1.0000     - ETA: 10s - loss: 0.0039 - acc: 1.0000 - ETA: 10s - loss: 0.0038 - acc: 1.0000 - ETA: 10s - loss: 0.0062 - acc: 1.0000 - ETA: 11s - loss: 0.0058 - acc: 1.0000 - ETA: 11s - loss: 0.0053 - acc: 1.0000 - ETA: 11s - loss: 0.0050 - acc: 1.0000 - ETA: 11s - loss: 0.0046 - acc: 1.0000 - ETA: 11s - loss: 0.0043 - acc: 1.0000 - ETA: 11s - loss: 0.0039 - acc: 1.0000 - ETA: 11s - loss: 0.0039 - acc: 1.0000 - ETA: 11s - loss: 0.0043 - acc: 1.0000 - ETA: 11s - loss: 0.0041 - acc: 1.0000 - ETA: 11s - loss: 0.0143 - acc: 0.9977 - ETA: 11s - loss: 0.0131 - acc: 0.9979 - ETA: 11s - loss: 0.0122 - acc: 0.9981 - ETA: 11s - loss: 0.0118 - acc: 0.9981 - ETA: 11s - loss: 0.0111 - acc: 0.9983 - ETA: 11s - loss: 0.0104 - acc: 0.9984 - ETA: 11s - loss: 0.0101 - acc: 0.9984 - ETA: 11s - loss: 0.0096 - acc: 0.9985 - ETA: 11s - loss: 0.0094 - acc: 0.9986 - ETA: 11s - loss: 0.0089 - acc: 0.9986 - ETA: 11s - loss: 0.0087 - acc: 0.9987 - ETA: 11s - loss: 0.0085 - acc: 0.9987 - ETA: 11s - loss: 0.0083 - acc: 0.9988 - ETA: 11s - loss: 0.0080 - acc: 0.9988 - ETA: 11s - loss: 0.0079 - acc: 0.9989 - ETA: 11s - loss: 0.0077 - acc: 0.9989 - ETA: 11s - loss: 0.0076 - acc: 0.9989 - ETA: 11s - loss: 0.0075 - acc: 0.9989 - ETA: 11s - loss: 0.0074 - acc: 0.9990 - ETA: 11s - loss: 0.0071 - acc: 0.9990 - ETA: 10s - loss: 0.0069 - acc: 0.9990 - ETA: 10s - loss: 0.0067 - acc: 0.9991 - ETA: 10s - loss: 0.0065 - acc: 0.9991 - ETA: 10s - loss: 0.0064 - acc: 0.9991 - ETA: 10s - loss: 0.0067 - acc: 0.9992 - ETA: 10s - loss: 0.0066 - acc: 0.9992 - ETA: 10s - loss: 0.0065 - acc: 0.9992 - ETA: 10s - loss: 0.0064 - acc: 0.9992 - ETA: 10s - loss: 0.0074 - acc: 0.9985 - ETA: 10s - loss: 0.0073 - acc: 0.9985 - ETA: 10s - loss: 0.0071 - acc: 0.9985 - ETA: 10s - loss: 0.0071 - acc: 0.9986 - ETA: 10s - loss: 0.0069 - acc: 0.9986 - ETA: 9s - loss: 0.0068 - acc: 0.9986  - ETA: 9s - loss: 0.0084 - acc: 0.9980 - ETA: 9s - loss: 0.0095 - acc: 0.9974 - ETA: 9s - loss: 0.0094 - acc: 0.9974 - ETA: 9s - loss: 0.0093 - acc: 0.9975 - ETA: 9s - loss: 0.0092 - acc: 0.9975 - ETA: 9s - loss: 0.0095 - acc: 0.9970 - ETA: 9s - loss: 0.0094 - acc: 0.9970 - ETA: 9s - loss: 0.0093 - acc: 0.9971 - ETA: 9s - loss: 0.0092 - acc: 0.9971 - ETA: 9s - loss: 0.0093 - acc: 0.9972 - ETA: 9s - loss: 0.0092 - acc: 0.9972 - ETA: 9s - loss: 0.0092 - acc: 0.9972 - ETA: 9s - loss: 0.0090 - acc: 0.9973 - ETA: 9s - loss: 0.0089 - acc: 0.9973 - ETA: 9s - loss: 0.0087 - acc: 0.9974 - ETA: 9s - loss: 0.0086 - acc: 0.9974 - ETA: 8s - loss: 0.0085 - acc: 0.9975 - ETA: 8s - loss: 0.0084 - acc: 0.9975 - ETA: 8s - loss: 0.0086 - acc: 0.9976 - ETA: 8s - loss: 0.0085 - acc: 0.9976 - ETA: 8s - loss: 0.0085 - acc: 0.9977 - ETA: 8s - loss: 0.0085 - acc: 0.9977 - ETA: 8s - loss: 0.0083 - acc: 0.9977 - ETA: 8s - loss: 0.0082 - acc: 0.9977 - ETA: 8s - loss: 0.0081 - acc: 0.9978 - ETA: 8s - loss: 0.0080 - acc: 0.9978 - ETA: 8s - loss: 0.0079 - acc: 0.9979 - ETA: 8s - loss: 0.0079 - acc: 0.9979 - ETA: 8s - loss: 0.0078 - acc: 0.9979 - ETA: 8s - loss: 0.0078 - acc: 0.9979 - ETA: 8s - loss: 0.0077 - acc: 0.9979 - ETA: 8s - loss: 0.0077 - acc: 0.9980 - ETA: 7s - loss: 0.0076 - acc: 0.9980 - ETA: 7s - loss: 0.0075 - acc: 0.9980 - ETA: 7s - loss: 0.0078 - acc: 0.9977 - ETA: 7s - loss: 0.0076 - acc: 0.9977 - ETA: 7s - loss: 0.0076 - acc: 0.9977 - ETA: 7s - loss: 0.0075 - acc: 0.9977 - ETA: 7s - loss: 0.0075 - acc: 0.9978 - ETA: 7s - loss: 0.0074 - acc: 0.9978 - ETA: 7s - loss: 0.0073 - acc: 0.9978 - ETA: 7s - loss: 0.0073 - acc: 0.9978 - ETA: 7s - loss: 0.0072 - acc: 0.9979 - ETA: 7s - loss: 0.0071 - acc: 0.9979 - ETA: 7s - loss: 0.0070 - acc: 0.9979 - ETA: 7s - loss: 0.0070 - acc: 0.9979 - ETA: 7s - loss: 0.0069 - acc: 0.9979 - ETA: 7s - loss: 0.0069 - acc: 0.9980 - ETA: 6s - loss: 0.0068 - acc: 0.9980 - ETA: 6s - loss: 0.0068 - acc: 0.9980 - ETA: 6s - loss: 0.0068 - acc: 0.9980 - ETA: 6s - loss: 0.0067 - acc: 0.9980 - ETA: 6s - loss: 0.0068 - acc: 0.9981 - ETA: 6s - loss: 0.0067 - acc: 0.9981 - ETA: 6s - loss: 0.0068 - acc: 0.9981 - ETA: 6s - loss: 0.0068 - acc: 0.9981 - ETA: 6s - loss: 0.0068 - acc: 0.9981 - ETA: 6s - loss: 0.0068 - acc: 0.9981 - ETA: 6s - loss: 0.0067 - acc: 0.9981 - ETA: 6s - loss: 0.0070 - acc: 0.9981 - ETA: 6s - loss: 0.0069 - acc: 0.9982 - ETA: 6s - loss: 0.0068 - acc: 0.9982 - ETA: 6s - loss: 0.0067 - acc: 0.9982 - ETA: 6s - loss: 0.0067 - acc: 0.9982 - ETA: 6s - loss: 0.0070 - acc: 0.9982 - ETA: 6s - loss: 0.0069 - acc: 0.9983 - ETA: 6s - loss: 0.0069 - acc: 0.9983 - ETA: 6s - loss: 0.0069 - acc: 0.9983 - ETA: 6s - loss: 0.0069 - acc: 0.9983 - ETA: 6s - loss: 0.0068 - acc: 0.9983 - ETA: 5s - loss: 0.0068 - acc: 0.9983 - ETA: 5s - loss: 0.0068 - acc: 0.9983 - ETA: 5s - loss: 0.0071 - acc: 0.9981 - ETA: 5s - loss: 0.0070 - acc: 0.9981 - ETA: 5s - loss: 0.0070 - acc: 0.9981 - ETA: 5s - loss: 0.0071 - acc: 0.9981 - ETA: 5s - loss: 0.0071 - acc: 0.9981 - ETA: 5s - loss: 0.0071 - acc: 0.9981 - ETA: 5s - loss: 0.0071 - acc: 0.9981 - ETA: 5s - loss: 0.0070 - acc: 0.9982 - ETA: 5s - loss: 0.0070 - acc: 0.9982 - ETA: 5s - loss: 0.0070 - acc: 0.9982 - ETA: 5s - loss: 0.0070 - acc: 0.9982 - ETA: 5s - loss: 0.0069 - acc: 0.9982 - ETA: 5s - loss: 0.0069 - acc: 0.9982 - ETA: 5s - loss: 0.0070 - acc: 0.9982 - ETA: 5s - loss: 0.0070 - acc: 0.9982 - ETA: 5s - loss: 0.0070 - acc: 0.9982 - ETA: 5s - loss: 0.0069 - acc: 0.9983 - ETA: 5s - loss: 0.0069 - acc: 0.9983 - ETA: 5s - loss: 0.0068 - acc: 0.9983 - ETA: 5s - loss: 0.0068 - acc: 0.9983 - ETA: 4s - loss: 0.0068 - acc: 0.9983 - ETA: 4s - loss: 0.0067 - acc: 0.9983 - ETA: 4s - loss: 0.0067 - acc: 0.9983 - ETA: 4s - loss: 0.0068 - acc: 0.9983 - ETA: 4s - loss: 0.0067 - acc: 0.9984 - ETA: 4s - loss: 0.0067 - acc: 0.9984 - ETA: 4s - loss: 0.0067 - acc: 0.9984 - ETA: 4s - loss: 0.0083 - acc: 0.9982 - ETA: 4s - loss: 0.0083 - acc: 0.9982 - ETA: 4s - loss: 0.0082 - acc: 0.9982 - ETA: 4s - loss: 0.0082 - acc: 0.9982 - ETA: 4s - loss: 0.0081 - acc: 0.9982 - ETA: 4s - loss: 0.0081 - acc: 0.9982 - ETA: 4s - loss: 0.0080 - acc: 0.9983 - ETA: 4s - loss: 0.0080 - acc: 0.9983 - ETA: 3s - loss: 0.0080 - acc: 0.9983 - ETA: 3s - loss: 0.0079 - acc: 0.9983 - ETA: 3s - loss: 0.0079 - acc: 0.9983 - ETA: 3s - loss: 0.0078 - acc: 0.9983 - ETA: 3s - loss: 0.0078 - acc: 0.9983 - ETA: 3s - loss: 0.0077 - acc: 0.9983 - ETA: 3s - loss: 0.0077 - acc: 0.9983 - ETA: 3s - loss: 0.0077 - acc: 0.9984 - ETA: 3s - loss: 0.0076 - acc: 0.9984 - ETA: 3s - loss: 0.0077 - acc: 0.9984 - ETA: 3s - loss: 0.0076 - acc: 0.9984 - ETA: 3s - loss: 0.0076 - acc: 0.9984 - ETA: 3s - loss: 0.0076 - acc: 0.9984 - ETA: 3s - loss: 0.0079 - acc: 0.9982 - ETA: 3s - loss: 0.0079 - acc: 0.9982 - ETA: 3s - loss: 0.0079 - acc: 0.9982 - ETA: 2s - loss: 0.0084 - acc: 0.9981 - ETA: 2s - loss: 0.0084 - acc: 0.9981 - ETA: 2s - loss: 0.0083 - acc: 0.9981 - ETA: 2s - loss: 0.0083 - acc: 0.9981 - ETA: 2s - loss: 0.0082 - acc: 0.9981 - ETA: 2s - loss: 0.0082 - acc: 0.9981 - ETA: 2s - loss: 0.0082 - acc: 0.9981 - ETA: 2s - loss: 0.0082 - acc: 0.9981 - ETA: 2s - loss: 0.0082 - acc: 0.9981 - ETA: 2s - loss: 0.0081 - acc: 0.9982 - ETA: 2s - loss: 0.0082 - acc: 0.9982 - ETA: 2s - loss: 0.0082 - acc: 0.9982 - ETA: 2s - loss: 0.0081 - acc: 0.9982 - ETA: 2s - loss: 0.0082 - acc: 0.9982 - ETA: 2s - loss: 0.0081 - acc: 0.9982 - ETA: 2s - loss: 0.0081 - acc: 0.9982 - ETA: 2s - loss: 0.0081 - acc: 0.9982 - ETA: 1s - loss: 0.0085 - acc: 0.9981 - ETA: 1s - loss: 0.0085 - acc: 0.9981 - ETA: 1s - loss: 0.0084 - acc: 0.9981 - ETA: 1s - loss: 0.0085 - acc: 0.9981 - ETA: 1s - loss: 0.0085 - acc: 0.9981 - ETA: 1s - loss: 0.0085 - acc: 0.9981 - ETA: 1s - loss: 0.0084 - acc: 0.9981 - ETA: 1s - loss: 0.0084 - acc: 0.9981 - ETA: 1s - loss: 0.0084 - acc: 0.9981 - ETA: 1s - loss: 0.0084 - acc: 0.9981 - ETA: 1s - loss: 0.0084 - acc: 0.9981 - ETA: 1s - loss: 0.0089 - acc: 0.9980 - ETA: 1s - loss: 0.0089 - acc: 0.9980 - ETA: 1s - loss: 0.0088 - acc: 0.9980 - ETA: 1s - loss: 0.0088 - acc: 0.9980 - ETA: 1s - loss: 0.0088 - acc: 0.9980 - ETA: 1s - loss: 0.0093 - acc: 0.9979 - ETA: 0s - loss: 0.0093 - acc: 0.9979 - ETA: 0s - loss: 0.0093 - acc: 0.9979 - ETA: 0s - loss: 0.0093 - acc: 0.9979 - ETA: 0s - loss: 0.0093 - acc: 0.9979 - ETA: 0s - loss: 0.0092 - acc: 0.9979 - ETA: 0s - loss: 0.0092 - acc: 0.9979 - ETA: 0s - loss: 0.0092 - acc: 0.9980 - ETA: 0s - loss: 0.0092 - acc: 0.9980 - ETA: 0s - loss: 0.0091 - acc: 0.9980 - ETA: 0s - loss: 0.0091 - acc: 0.9980 - ETA: 0s - loss: 0.0091 - acc: 0.9980 - ETA: 0s - loss: 0.0092 - acc: 0.9979 - ETA: 0s - loss: 0.0091 - acc: 0.9979 - ETA: 0s - loss: 0.0093 - acc: 0.9977 - ETA: 0s - loss: 0.0092 - acc: 0.9977Epoch 00014: val_loss did not improve
6680/6680 [==============================] - 13s - loss: 0.0093 - acc: 0.9978 - val_loss: 0.8507 - val_acc: 0.8240
Epoch 16/20
6660/6680 [============================>.] - ETA: 6s - loss: 0.0019 - acc: 1.0000 - ETA: 9s - loss: 8.8223e-04 - acc: 1.0000 - ETA: 9s - loss: 6.9642e-04 - acc: 1.0000 - ETA: 10s - loss: 6.3750e-04 - acc: 1.0000 - ETA: 11s - loss: 0.0018 - acc: 1.0000     - ETA: 10s - loss: 0.0015 - acc: 1.0000 - ETA: 11s - loss: 0.0014 - acc: 1.0000 - ETA: 11s - loss: 0.0013 - acc: 1.0000 - ETA: 10s - loss: 0.0092 - acc: 0.9967 - ETA: 11s - loss: 0.0086 - acc: 0.9969 - ETA: 11s - loss: 0.0079 - acc: 0.9972 - ETA: 10s - loss: 0.0076 - acc: 0.9975 - ETA: 11s - loss: 0.0076 - acc: 0.9976 - ETA: 10s - loss: 0.0070 - acc: 0.9978 - ETA: 10s - loss: 0.0066 - acc: 0.9980 - ETA: 10s - loss: 0.0075 - acc: 0.9981 - ETA: 11s - loss: 0.0072 - acc: 0.9981 - ETA: 10s - loss: 0.0068 - acc: 0.9983 - ETA: 11s - loss: 0.0066 - acc: 0.9983 - ETA: 10s - loss: 0.0062 - acc: 0.9984 - ETA: 10s - loss: 0.0060 - acc: 0.9985 - ETA: 11s - loss: 0.0064 - acc: 0.9985 - ETA: 10s - loss: 0.0062 - acc: 0.9986 - ETA: 10s - loss: 0.0062 - acc: 0.9987 - ETA: 10s - loss: 0.0063 - acc: 0.9987 - ETA: 10s - loss: 0.0060 - acc: 0.9988 - ETA: 10s - loss: 0.0058 - acc: 0.9989 - ETA: 10s - loss: 0.0057 - acc: 0.9989 - ETA: 10s - loss: 0.0056 - acc: 0.9989 - ETA: 10s - loss: 0.0053 - acc: 0.9990 - ETA: 10s - loss: 0.0053 - acc: 0.9990 - ETA: 10s - loss: 0.0051 - acc: 0.9990 - ETA: 10s - loss: 0.0050 - acc: 0.9991 - ETA: 10s - loss: 0.0049 - acc: 0.9991 - ETA: 10s - loss: 0.0048 - acc: 0.9991 - ETA: 9s - loss: 0.0047 - acc: 0.9992  - ETA: 9s - loss: 0.0046 - acc: 0.9992 - ETA: 9s - loss: 0.0046 - acc: 0.9992 - ETA: 9s - loss: 0.0057 - acc: 0.9984 - ETA: 9s - loss: 0.0056 - acc: 0.9985 - ETA: 9s - loss: 0.0056 - acc: 0.9985 - ETA: 9s - loss: 0.0056 - acc: 0.9985 - ETA: 9s - loss: 0.0055 - acc: 0.9985 - ETA: 9s - loss: 0.0054 - acc: 0.9986 - ETA: 9s - loss: 0.0055 - acc: 0.9986 - ETA: 9s - loss: 0.0054 - acc: 0.9986 - ETA: 9s - loss: 0.0053 - acc: 0.9987 - ETA: 9s - loss: 0.0052 - acc: 0.9987 - ETA: 9s - loss: 0.0051 - acc: 0.9987 - ETA: 9s - loss: 0.0050 - acc: 0.9988 - ETA: 9s - loss: 0.0049 - acc: 0.9988 - ETA: 9s - loss: 0.0054 - acc: 0.9982 - ETA: 9s - loss: 0.0053 - acc: 0.9982 - ETA: 9s - loss: 0.0052 - acc: 0.9983 - ETA: 9s - loss: 0.0051 - acc: 0.9983 - ETA: 9s - loss: 0.0051 - acc: 0.9983 - ETA: 8s - loss: 0.0077 - acc: 0.9978 - ETA: 8s - loss: 0.0077 - acc: 0.9979 - ETA: 8s - loss: 0.0076 - acc: 0.9979 - ETA: 8s - loss: 0.0074 - acc: 0.9980 - ETA: 8s - loss: 0.0074 - acc: 0.9980 - ETA: 8s - loss: 0.0074 - acc: 0.9980 - ETA: 8s - loss: 0.0073 - acc: 0.9980 - ETA: 8s - loss: 0.0072 - acc: 0.9981 - ETA: 8s - loss: 0.0072 - acc: 0.9981 - ETA: 8s - loss: 0.0072 - acc: 0.9981 - ETA: 8s - loss: 0.0071 - acc: 0.9981 - ETA: 8s - loss: 0.0070 - acc: 0.9982 - ETA: 8s - loss: 0.0073 - acc: 0.9982 - ETA: 8s - loss: 0.0073 - acc: 0.9982 - ETA: 8s - loss: 0.0074 - acc: 0.9982 - ETA: 8s - loss: 0.0073 - acc: 0.9982 - ETA: 8s - loss: 0.0073 - acc: 0.9982 - ETA: 8s - loss: 0.0072 - acc: 0.9983 - ETA: 8s - loss: 0.0071 - acc: 0.9983 - ETA: 8s - loss: 0.0071 - acc: 0.9983 - ETA: 8s - loss: 0.0070 - acc: 0.9983 - ETA: 8s - loss: 0.0068 - acc: 0.9984 - ETA: 8s - loss: 0.0069 - acc: 0.9984 - ETA: 8s - loss: 0.0075 - acc: 0.9980 - ETA: 8s - loss: 0.0074 - acc: 0.9980 - ETA: 8s - loss: 0.0074 - acc: 0.9980 - ETA: 8s - loss: 0.0073 - acc: 0.9980 - ETA: 8s - loss: 0.0073 - acc: 0.9980 - ETA: 8s - loss: 0.0072 - acc: 0.9981 - ETA: 8s - loss: 0.0072 - acc: 0.9981 - ETA: 8s - loss: 0.0073 - acc: 0.9981 - ETA: 8s - loss: 0.0072 - acc: 0.9981 - ETA: 8s - loss: 0.0072 - acc: 0.9981 - ETA: 8s - loss: 0.0071 - acc: 0.9981 - ETA: 8s - loss: 0.0071 - acc: 0.9981 - ETA: 8s - loss: 0.0071 - acc: 0.9982 - ETA: 8s - loss: 0.0070 - acc: 0.9982 - ETA: 8s - loss: 0.0072 - acc: 0.9982 - ETA: 8s - loss: 0.0072 - acc: 0.9982 - ETA: 8s - loss: 0.0071 - acc: 0.9982 - ETA: 8s - loss: 0.0071 - acc: 0.9982 - ETA: 8s - loss: 0.0070 - acc: 0.9982 - ETA: 8s - loss: 0.0070 - acc: 0.9983 - ETA: 8s - loss: 0.0070 - acc: 0.9983 - ETA: 8s - loss: 0.0069 - acc: 0.9983 - ETA: 8s - loss: 0.0069 - acc: 0.9983 - ETA: 8s - loss: 0.0071 - acc: 0.9983 - ETA: 8s - loss: 0.0070 - acc: 0.9983 - ETA: 8s - loss: 0.0070 - acc: 0.9983 - ETA: 8s - loss: 0.0070 - acc: 0.9983 - ETA: 8s - loss: 0.0069 - acc: 0.9983 - ETA: 8s - loss: 0.0069 - acc: 0.9984 - ETA: 8s - loss: 0.0069 - acc: 0.9984 - ETA: 8s - loss: 0.0068 - acc: 0.9984 - ETA: 8s - loss: 0.0068 - acc: 0.9984 - ETA: 8s - loss: 0.0068 - acc: 0.9984 - ETA: 8s - loss: 0.0067 - acc: 0.9984 - ETA: 8s - loss: 0.0067 - acc: 0.9984 - ETA: 8s - loss: 0.0067 - acc: 0.9984 - ETA: 8s - loss: 0.0066 - acc: 0.9984 - ETA: 8s - loss: 0.0066 - acc: 0.9984 - ETA: 8s - loss: 0.0066 - acc: 0.9985 - ETA: 8s - loss: 0.0068 - acc: 0.9982 - ETA: 8s - loss: 0.0068 - acc: 0.9982 - ETA: 8s - loss: 0.0068 - acc: 0.9982 - ETA: 8s - loss: 0.0068 - acc: 0.9982 - ETA: 8s - loss: 0.0067 - acc: 0.9982 - ETA: 8s - loss: 0.0067 - acc: 0.9982 - ETA: 8s - loss: 0.0067 - acc: 0.9982 - ETA: 7s - loss: 0.0066 - acc: 0.9982 - ETA: 7s - loss: 0.0066 - acc: 0.9983 - ETA: 7s - loss: 0.0069 - acc: 0.9980 - ETA: 7s - loss: 0.0072 - acc: 0.9977 - ETA: 7s - loss: 0.0072 - acc: 0.9977 - ETA: 7s - loss: 0.0071 - acc: 0.9977 - ETA: 7s - loss: 0.0071 - acc: 0.9978 - ETA: 7s - loss: 0.0071 - acc: 0.9978 - ETA: 7s - loss: 0.0071 - acc: 0.9978 - ETA: 7s - loss: 0.0070 - acc: 0.9978 - ETA: 7s - loss: 0.0071 - acc: 0.9978 - ETA: 7s - loss: 0.0071 - acc: 0.9978 - ETA: 7s - loss: 0.0071 - acc: 0.9978 - ETA: 7s - loss: 0.0071 - acc: 0.9978 - ETA: 7s - loss: 0.0071 - acc: 0.9978 - ETA: 7s - loss: 0.0071 - acc: 0.9979 - ETA: 7s - loss: 0.0070 - acc: 0.9979 - ETA: 7s - loss: 0.0070 - acc: 0.9979 - ETA: 7s - loss: 0.0070 - acc: 0.9979 - ETA: 7s - loss: 0.0069 - acc: 0.9979 - ETA: 6s - loss: 0.0069 - acc: 0.9979 - ETA: 6s - loss: 0.0069 - acc: 0.9979 - ETA: 6s - loss: 0.0068 - acc: 0.9979 - ETA: 6s - loss: 0.0068 - acc: 0.9980 - ETA: 6s - loss: 0.0067 - acc: 0.9980 - ETA: 6s - loss: 0.0067 - acc: 0.9980 - ETA: 6s - loss: 0.0066 - acc: 0.9980 - ETA: 6s - loss: 0.0066 - acc: 0.9980 - ETA: 6s - loss: 0.0066 - acc: 0.9980 - ETA: 6s - loss: 0.0066 - acc: 0.9980 - ETA: 6s - loss: 0.0065 - acc: 0.9981 - ETA: 6s - loss: 0.0065 - acc: 0.9981 - ETA: 6s - loss: 0.0067 - acc: 0.9978 - ETA: 5s - loss: 0.0066 - acc: 0.9979 - ETA: 5s - loss: 0.0066 - acc: 0.9979 - ETA: 5s - loss: 0.0066 - acc: 0.9979 - ETA: 5s - loss: 0.0067 - acc: 0.9979 - ETA: 5s - loss: 0.0067 - acc: 0.9979 - ETA: 5s - loss: 0.0066 - acc: 0.9979 - ETA: 5s - loss: 0.0066 - acc: 0.9979 - ETA: 5s - loss: 0.0067 - acc: 0.9979 - ETA: 5s - loss: 0.0067 - acc: 0.9979 - ETA: 5s - loss: 0.0067 - acc: 0.9980 - ETA: 5s - loss: 0.0067 - acc: 0.9980 - ETA: 5s - loss: 0.0066 - acc: 0.9980 - ETA: 5s - loss: 0.0067 - acc: 0.9980 - ETA: 5s - loss: 0.0067 - acc: 0.9980 - ETA: 5s - loss: 0.0067 - acc: 0.9980 - ETA: 5s - loss: 0.0066 - acc: 0.9980 - ETA: 5s - loss: 0.0066 - acc: 0.9980 - ETA: 5s - loss: 0.0069 - acc: 0.9978 - ETA: 5s - loss: 0.0069 - acc: 0.9978 - ETA: 5s - loss: 0.0068 - acc: 0.9978 - ETA: 5s - loss: 0.0068 - acc: 0.9978 - ETA: 5s - loss: 0.0068 - acc: 0.9978 - ETA: 5s - loss: 0.0069 - acc: 0.9979 - ETA: 5s - loss: 0.0069 - acc: 0.9979 - ETA: 5s - loss: 0.0069 - acc: 0.9979 - ETA: 5s - loss: 0.0068 - acc: 0.9979 - ETA: 4s - loss: 0.0068 - acc: 0.9979 - ETA: 4s - loss: 0.0068 - acc: 0.9979 - ETA: 4s - loss: 0.0068 - acc: 0.9979 - ETA: 4s - loss: 0.0067 - acc: 0.9979 - ETA: 4s - loss: 0.0067 - acc: 0.9979 - ETA: 4s - loss: 0.0067 - acc: 0.9979 - ETA: 4s - loss: 0.0067 - acc: 0.9979 - ETA: 4s - loss: 0.0067 - acc: 0.9980 - ETA: 4s - loss: 0.0067 - acc: 0.9980 - ETA: 4s - loss: 0.0067 - acc: 0.9980 - ETA: 4s - loss: 0.0067 - acc: 0.9980 - ETA: 4s - loss: 0.0066 - acc: 0.9980 - ETA: 4s - loss: 0.0066 - acc: 0.9980 - ETA: 4s - loss: 0.0066 - acc: 0.9980 - ETA: 4s - loss: 0.0065 - acc: 0.9980 - ETA: 3s - loss: 0.0066 - acc: 0.9980 - ETA: 3s - loss: 0.0066 - acc: 0.9981 - ETA: 3s - loss: 0.0066 - acc: 0.9981 - ETA: 3s - loss: 0.0070 - acc: 0.9979 - ETA: 3s - loss: 0.0070 - acc: 0.9979 - ETA: 3s - loss: 0.0070 - acc: 0.9979 - ETA: 3s - loss: 0.0074 - acc: 0.9978 - ETA: 3s - loss: 0.0074 - acc: 0.9978 - ETA: 3s - loss: 0.0074 - acc: 0.9978 - ETA: 3s - loss: 0.0073 - acc: 0.9978 - ETA: 2s - loss: 0.0073 - acc: 0.9978 - ETA: 2s - loss: 0.0073 - acc: 0.9978 - ETA: 2s - loss: 0.0073 - acc: 0.9978 - ETA: 2s - loss: 0.0073 - acc: 0.9978 - ETA: 2s - loss: 0.0072 - acc: 0.9979 - ETA: 2s - loss: 0.0072 - acc: 0.9979 - ETA: 2s - loss: 0.0072 - acc: 0.9979 - ETA: 2s - loss: 0.0072 - acc: 0.9979 - ETA: 2s - loss: 0.0071 - acc: 0.9979 - ETA: 2s - loss: 0.0071 - acc: 0.9979 - ETA: 2s - loss: 0.0071 - acc: 0.9979 - ETA: 2s - loss: 0.0072 - acc: 0.9979 - ETA: 2s - loss: 0.0072 - acc: 0.9980 - ETA: 1s - loss: 0.0072 - acc: 0.9980 - ETA: 1s - loss: 0.0071 - acc: 0.9980 - ETA: 1s - loss: 0.0071 - acc: 0.9980 - ETA: 1s - loss: 0.0071 - acc: 0.9980 - ETA: 1s - loss: 0.0071 - acc: 0.9980 - ETA: 1s - loss: 0.0071 - acc: 0.9980 - ETA: 1s - loss: 0.0070 - acc: 0.9980 - ETA: 1s - loss: 0.0070 - acc: 0.9980 - ETA: 1s - loss: 0.0070 - acc: 0.9980 - ETA: 1s - loss: 0.0070 - acc: 0.9980 - ETA: 1s - loss: 0.0070 - acc: 0.9980 - ETA: 1s - loss: 0.0070 - acc: 0.9980 - ETA: 1s - loss: 0.0071 - acc: 0.9980 - ETA: 1s - loss: 0.0071 - acc: 0.9980 - ETA: 1s - loss: 0.0071 - acc: 0.9981 - ETA: 1s - loss: 0.0070 - acc: 0.9981 - ETA: 1s - loss: 0.0070 - acc: 0.9981 - ETA: 1s - loss: 0.0070 - acc: 0.9981 - ETA: 1s - loss: 0.0070 - acc: 0.9981 - ETA: 0s - loss: 0.0070 - acc: 0.9981 - ETA: 0s - loss: 0.0069 - acc: 0.9981 - ETA: 0s - loss: 0.0069 - acc: 0.9981 - ETA: 0s - loss: 0.0069 - acc: 0.9981 - ETA: 0s - loss: 0.0069 - acc: 0.9981 - ETA: 0s - loss: 0.0069 - acc: 0.9981 - ETA: 0s - loss: 0.0069 - acc: 0.9981 - ETA: 0s - loss: 0.0069 - acc: 0.9981 - ETA: 0s - loss: 0.0068 - acc: 0.9981 - ETA: 0s - loss: 0.0068 - acc: 0.9981 - ETA: 0s - loss: 0.0068 - acc: 0.9981 - ETA: 0s - loss: 0.0068 - acc: 0.9982 - ETA: 0s - loss: 0.0069 - acc: 0.9982 - ETA: 0s - loss: 0.0068 - acc: 0.9982 - ETA: 0s - loss: 0.0068 - acc: 0.9982 - ETA: 0s - loss: 0.0068 - acc: 0.9982 - ETA: 0s - loss: 0.0068 - acc: 0.9982 - ETA: 0s - loss: 0.0068 - acc: 0.9982 - ETA: 0s - loss: 0.0068 - acc: 0.9982 - ETA: 0s - loss: 0.0068 - acc: 0.9982Epoch 00015: val_loss did not improve
6680/6680 [==============================] - 17s - loss: 0.0068 - acc: 0.9982 - val_loss: 0.8445 - val_acc: 0.8216
Epoch 17/20
6660/6680 [============================>.] - ETA: 9s - loss: 7.1854e-05 - acc: 1.0000 - ETA: 13s - loss: 1.9463e-04 - acc: 1.0000 - ETA: 15s - loss: 4.4955e-04 - acc: 1.0000 - ETA: 15s - loss: 3.5548e-04 - acc: 1.0000 - ETA: 15s - loss: 0.0067 - acc: 1.0000     - ETA: 14s - loss: 0.0074 - acc: 1.0000 - ETA: 14s - loss: 0.0071 - acc: 1.0000 - ETA: 15s - loss: 0.0064 - acc: 1.0000 - ETA: 15s - loss: 0.0059 - acc: 1.0000 - ETA: 15s - loss: 0.0054 - acc: 1.0000 - ETA: 15s - loss: 0.0051 - acc: 1.0000 - ETA: 15s - loss: 0.0048 - acc: 1.0000 - ETA: 15s - loss: 0.0044 - acc: 1.0000 - ETA: 16s - loss: 0.0041 - acc: 1.0000 - ETA: 16s - loss: 0.0040 - acc: 1.0000 - ETA: 16s - loss: 0.0038 - acc: 1.0000 - ETA: 15s - loss: 0.0036 - acc: 1.0000 - ETA: 15s - loss: 0.0035 - acc: 1.0000 - ETA: 15s - loss: 0.0033 - acc: 1.0000 - ETA: 15s - loss: 0.0032 - acc: 1.0000 - ETA: 15s - loss: 0.0031 - acc: 1.0000 - ETA: 15s - loss: 0.0031 - acc: 1.0000 - ETA: 15s - loss: 0.0030 - acc: 1.0000 - ETA: 15s - loss: 0.0029 - acc: 1.0000 - ETA: 15s - loss: 0.0028 - acc: 1.0000 - ETA: 15s - loss: 0.0034 - acc: 1.0000 - ETA: 14s - loss: 0.0032 - acc: 1.0000 - ETA: 14s - loss: 0.0031 - acc: 1.0000 - ETA: 14s - loss: 0.0030 - acc: 1.0000 - ETA: 14s - loss: 0.0029 - acc: 1.0000 - ETA: 14s - loss: 0.0028 - acc: 1.0000 - ETA: 14s - loss: 0.0027 - acc: 1.0000 - ETA: 14s - loss: 0.0027 - acc: 1.0000 - ETA: 13s - loss: 0.0027 - acc: 1.0000 - ETA: 13s - loss: 0.0026 - acc: 1.0000 - ETA: 13s - loss: 0.0026 - acc: 1.0000 - ETA: 13s - loss: 0.0025 - acc: 1.0000 - ETA: 13s - loss: 0.0025 - acc: 1.0000 - ETA: 13s - loss: 0.0024 - acc: 1.0000 - ETA: 13s - loss: 0.0024 - acc: 1.0000 - ETA: 13s - loss: 0.0023 - acc: 1.0000 - ETA: 13s - loss: 0.0023 - acc: 1.0000 - ETA: 13s - loss: 0.0022 - acc: 1.0000 - ETA: 13s - loss: 0.0022 - acc: 1.0000 - ETA: 13s - loss: 0.0021 - acc: 1.0000 - ETA: 13s - loss: 0.0021 - acc: 1.0000 - ETA: 13s - loss: 0.0021 - acc: 1.0000 - ETA: 13s - loss: 0.0020 - acc: 1.0000 - ETA: 13s - loss: 0.0115 - acc: 0.9991 - ETA: 13s - loss: 0.0113 - acc: 0.9991 - ETA: 13s - loss: 0.0112 - acc: 0.9991 - ETA: 13s - loss: 0.0113 - acc: 0.9992 - ETA: 14s - loss: 0.0112 - acc: 0.9992 - ETA: 14s - loss: 0.0111 - acc: 0.9992 - ETA: 14s - loss: 0.0116 - acc: 0.9984 - ETA: 14s - loss: 0.0114 - acc: 0.9984 - ETA: 14s - loss: 0.0113 - acc: 0.9984 - ETA: 14s - loss: 0.0112 - acc: 0.9985 - ETA: 14s - loss: 0.0110 - acc: 0.9985 - ETA: 14s - loss: 0.0109 - acc: 0.9985 - ETA: 14s - loss: 0.0114 - acc: 0.9978 - ETA: 14s - loss: 0.0112 - acc: 0.9978 - ETA: 14s - loss: 0.0111 - acc: 0.9979 - ETA: 14s - loss: 0.0110 - acc: 0.9979 - ETA: 14s - loss: 0.0108 - acc: 0.9979 - ETA: 14s - loss: 0.0107 - acc: 0.9979 - ETA: 14s - loss: 0.0113 - acc: 0.9973 - ETA: 13s - loss: 0.0112 - acc: 0.9974 - ETA: 13s - loss: 0.0111 - acc: 0.9974 - ETA: 13s - loss: 0.0108 - acc: 0.9975 - ETA: 13s - loss: 0.0107 - acc: 0.9975 - ETA: 13s - loss: 0.0106 - acc: 0.9976 - ETA: 13s - loss: 0.0103 - acc: 0.9976 - ETA: 12s - loss: 0.0101 - acc: 0.9977 - ETA: 12s - loss: 0.0100 - acc: 0.9977 - ETA: 12s - loss: 0.0100 - acc: 0.9978 - ETA: 12s - loss: 0.0098 - acc: 0.9978 - ETA: 12s - loss: 0.0097 - acc: 0.9978 - ETA: 12s - loss: 0.0095 - acc: 0.9979 - ETA: 12s - loss: 0.0094 - acc: 0.9979 - ETA: 12s - loss: 0.0093 - acc: 0.9979 - ETA: 11s - loss: 0.0092 - acc: 0.9980 - ETA: 11s - loss: 0.0090 - acc: 0.9980 - ETA: 11s - loss: 0.0089 - acc: 0.9980 - ETA: 11s - loss: 0.0088 - acc: 0.9980 - ETA: 11s - loss: 0.0087 - acc: 0.9981 - ETA: 11s - loss: 0.0086 - acc: 0.9981 - ETA: 11s - loss: 0.0085 - acc: 0.9981 - ETA: 11s - loss: 0.0083 - acc: 0.9982 - ETA: 10s - loss: 0.0082 - acc: 0.9982 - ETA: 10s - loss: 0.0081 - acc: 0.9982 - ETA: 10s - loss: 0.0080 - acc: 0.9982 - ETA: 10s - loss: 0.0078 - acc: 0.9983 - ETA: 10s - loss: 0.0078 - acc: 0.9983 - ETA: 10s - loss: 0.0096 - acc: 0.9979 - ETA: 10s - loss: 0.0095 - acc: 0.9979 - ETA: 10s - loss: 0.0094 - acc: 0.9980 - ETA: 9s - loss: 0.0092 - acc: 0.9980  - ETA: 9s - loss: 0.0091 - acc: 0.9980 - ETA: 9s - loss: 0.0090 - acc: 0.9980 - ETA: 9s - loss: 0.0089 - acc: 0.9981 - ETA: 9s - loss: 0.0089 - acc: 0.9981 - ETA: 9s - loss: 0.0088 - acc: 0.9981 - ETA: 9s - loss: 0.0087 - acc: 0.9981 - ETA: 9s - loss: 0.0087 - acc: 0.9981 - ETA: 9s - loss: 0.0086 - acc: 0.9982 - ETA: 9s - loss: 0.0085 - acc: 0.9982 - ETA: 9s - loss: 0.0084 - acc: 0.9982 - ETA: 9s - loss: 0.0084 - acc: 0.9982 - ETA: 8s - loss: 0.0083 - acc: 0.9982 - ETA: 8s - loss: 0.0083 - acc: 0.9983 - ETA: 8s - loss: 0.0082 - acc: 0.9983 - ETA: 8s - loss: 0.0082 - acc: 0.9983 - ETA: 8s - loss: 0.0081 - acc: 0.9983 - ETA: 8s - loss: 0.0101 - acc: 0.9980 - ETA: 8s - loss: 0.0100 - acc: 0.9980 - ETA: 8s - loss: 0.0099 - acc: 0.9980 - ETA: 8s - loss: 0.0100 - acc: 0.9980 - ETA: 8s - loss: 0.0099 - acc: 0.9981 - ETA: 8s - loss: 0.0098 - acc: 0.9981 - ETA: 8s - loss: 0.0097 - acc: 0.9981 - ETA: 8s - loss: 0.0096 - acc: 0.9981 - ETA: 7s - loss: 0.0096 - acc: 0.9981 - ETA: 7s - loss: 0.0095 - acc: 0.9982 - ETA: 7s - loss: 0.0095 - acc: 0.9982 - ETA: 7s - loss: 0.0094 - acc: 0.9982 - ETA: 7s - loss: 0.0093 - acc: 0.9982 - ETA: 7s - loss: 0.0092 - acc: 0.9982 - ETA: 7s - loss: 0.0092 - acc: 0.9982 - ETA: 7s - loss: 0.0091 - acc: 0.9983 - ETA: 7s - loss: 0.0090 - acc: 0.9983 - ETA: 7s - loss: 0.0090 - acc: 0.9983 - ETA: 7s - loss: 0.0089 - acc: 0.9983 - ETA: 7s - loss: 0.0089 - acc: 0.9983 - ETA: 7s - loss: 0.0088 - acc: 0.9983 - ETA: 6s - loss: 0.0088 - acc: 0.9983 - ETA: 6s - loss: 0.0087 - acc: 0.9983 - ETA: 6s - loss: 0.0087 - acc: 0.9984 - ETA: 6s - loss: 0.0087 - acc: 0.9984 - ETA: 6s - loss: 0.0086 - acc: 0.9984 - ETA: 6s - loss: 0.0085 - acc: 0.9984 - ETA: 6s - loss: 0.0086 - acc: 0.9984 - ETA: 6s - loss: 0.0086 - acc: 0.9984 - ETA: 6s - loss: 0.0085 - acc: 0.9984 - ETA: 6s - loss: 0.0085 - acc: 0.9984 - ETA: 6s - loss: 0.0085 - acc: 0.9985 - ETA: 6s - loss: 0.0084 - acc: 0.9985 - ETA: 6s - loss: 0.0084 - acc: 0.9985 - ETA: 6s - loss: 0.0083 - acc: 0.9985 - ETA: 5s - loss: 0.0083 - acc: 0.9985 - ETA: 5s - loss: 0.0083 - acc: 0.9985 - ETA: 5s - loss: 0.0082 - acc: 0.9985 - ETA: 5s - loss: 0.0082 - acc: 0.9985 - ETA: 5s - loss: 0.0081 - acc: 0.9986 - ETA: 5s - loss: 0.0081 - acc: 0.9986 - ETA: 5s - loss: 0.0081 - acc: 0.9986 - ETA: 5s - loss: 0.0080 - acc: 0.9986 - ETA: 5s - loss: 0.0081 - acc: 0.9986 - ETA: 5s - loss: 0.0080 - acc: 0.9986 - ETA: 5s - loss: 0.0080 - acc: 0.9986 - ETA: 5s - loss: 0.0080 - acc: 0.9986 - ETA: 5s - loss: 0.0079 - acc: 0.9986 - ETA: 5s - loss: 0.0079 - acc: 0.9986 - ETA: 4s - loss: 0.0078 - acc: 0.9986 - ETA: 4s - loss: 0.0078 - acc: 0.9987 - ETA: 4s - loss: 0.0078 - acc: 0.9987 - ETA: 4s - loss: 0.0077 - acc: 0.9987 - ETA: 4s - loss: 0.0077 - acc: 0.9987 - ETA: 4s - loss: 0.0077 - acc: 0.9987 - ETA: 4s - loss: 0.0076 - acc: 0.9987 - ETA: 4s - loss: 0.0076 - acc: 0.9987 - ETA: 4s - loss: 0.0076 - acc: 0.9987 - ETA: 4s - loss: 0.0075 - acc: 0.9987 - ETA: 4s - loss: 0.0075 - acc: 0.9987 - ETA: 4s - loss: 0.0076 - acc: 0.9987 - ETA: 4s - loss: 0.0075 - acc: 0.9988 - ETA: 3s - loss: 0.0075 - acc: 0.9988 - ETA: 3s - loss: 0.0074 - acc: 0.9988 - ETA: 3s - loss: 0.0074 - acc: 0.9988 - ETA: 3s - loss: 0.0073 - acc: 0.9988 - ETA: 3s - loss: 0.0073 - acc: 0.9988 - ETA: 3s - loss: 0.0073 - acc: 0.9988 - ETA: 3s - loss: 0.0073 - acc: 0.9988 - ETA: 3s - loss: 0.0072 - acc: 0.9988 - ETA: 3s - loss: 0.0072 - acc: 0.9988 - ETA: 3s - loss: 0.0072 - acc: 0.9988 - ETA: 3s - loss: 0.0072 - acc: 0.9988 - ETA: 3s - loss: 0.0071 - acc: 0.9988 - ETA: 3s - loss: 0.0071 - acc: 0.9989 - ETA: 3s - loss: 0.0071 - acc: 0.9989 - ETA: 3s - loss: 0.0071 - acc: 0.9989 - ETA: 2s - loss: 0.0071 - acc: 0.9989 - ETA: 2s - loss: 0.0076 - acc: 0.9985 - ETA: 2s - loss: 0.0076 - acc: 0.9985 - ETA: 2s - loss: 0.0076 - acc: 0.9985 - ETA: 2s - loss: 0.0075 - acc: 0.9985 - ETA: 2s - loss: 0.0075 - acc: 0.9985 - ETA: 2s - loss: 0.0075 - acc: 0.9985 - ETA: 2s - loss: 0.0076 - acc: 0.9986 - ETA: 2s - loss: 0.0075 - acc: 0.9986 - ETA: 2s - loss: 0.0075 - acc: 0.9986 - ETA: 2s - loss: 0.0075 - acc: 0.9986 - ETA: 2s - loss: 0.0074 - acc: 0.9986 - ETA: 2s - loss: 0.0074 - acc: 0.9986 - ETA: 2s - loss: 0.0074 - acc: 0.9986 - ETA: 2s - loss: 0.0074 - acc: 0.9986 - ETA: 1s - loss: 0.0074 - acc: 0.9986 - ETA: 1s - loss: 0.0073 - acc: 0.9986 - ETA: 1s - loss: 0.0073 - acc: 0.9986 - ETA: 1s - loss: 0.0081 - acc: 0.9985 - ETA: 1s - loss: 0.0081 - acc: 0.9985 - ETA: 1s - loss: 0.0081 - acc: 0.9985 - ETA: 1s - loss: 0.0080 - acc: 0.9985 - ETA: 1s - loss: 0.0080 - acc: 0.9985 - ETA: 1s - loss: 0.0080 - acc: 0.9985 - ETA: 1s - loss: 0.0079 - acc: 0.9985 - ETA: 1s - loss: 0.0079 - acc: 0.9985 - ETA: 1s - loss: 0.0079 - acc: 0.9985 - ETA: 1s - loss: 0.0079 - acc: 0.9985 - ETA: 1s - loss: 0.0082 - acc: 0.9984 - ETA: 0s - loss: 0.0081 - acc: 0.9984 - ETA: 0s - loss: 0.0084 - acc: 0.9982 - ETA: 0s - loss: 0.0084 - acc: 0.9982 - ETA: 0s - loss: 0.0084 - acc: 0.9983 - ETA: 0s - loss: 0.0084 - acc: 0.9983 - ETA: 0s - loss: 0.0083 - acc: 0.9983 - ETA: 0s - loss: 0.0083 - acc: 0.9983 - ETA: 0s - loss: 0.0083 - acc: 0.9983 - ETA: 0s - loss: 0.0082 - acc: 0.9983 - ETA: 0s - loss: 0.0087 - acc: 0.9981 - ETA: 0s - loss: 0.0087 - acc: 0.9981 - ETA: 0s - loss: 0.0087 - acc: 0.9981 - ETA: 0s - loss: 0.0086 - acc: 0.9982 - ETA: 0s - loss: 0.0086 - acc: 0.9982 - ETA: 0s - loss: 0.0086 - acc: 0.9982 - ETA: 0s - loss: 0.0086 - acc: 0.9982 - ETA: 0s - loss: 0.0086 - acc: 0.9982 - ETA: 0s - loss: 0.0085 - acc: 0.9982 - ETA: 0s - loss: 0.0085 - acc: 0.9982Epoch 00016: val_loss did not improve
6680/6680 [==============================] - 14s - loss: 0.0085 - acc: 0.9982 - val_loss: 0.9127 - val_acc: 0.8108
Epoch 18/20
6640/6680 [============================>.] - ETA: 9s - loss: 5.6824e-04 - acc: 1.0000 - ETA: 11s - loss: 0.0111 - acc: 1.0000    - ETA: 11s - loss: 0.0067 - acc: 1.0000 - ETA: 11s - loss: 0.0181 - acc: 0.9929 - ETA: 11s - loss: 0.0159 - acc: 0.9937 - ETA: 12s - loss: 0.0142 - acc: 0.9944 - ETA: 12s - loss: 0.0128 - acc: 0.9950 - ETA: 13s - loss: 0.0117 - acc: 0.9955 - ETA: 13s - loss: 0.0107 - acc: 0.9958 - ETA: 13s - loss: 0.0100 - acc: 0.9962 - ETA: 14s - loss: 0.0093 - acc: 0.9964 - ETA: 14s - loss: 0.0088 - acc: 0.9967 - ETA: 14s - loss: 0.0082 - acc: 0.9969 - ETA: 14s - loss: 0.0078 - acc: 0.9971 - ETA: 14s - loss: 0.0074 - acc: 0.9972 - ETA: 14s - loss: 0.0067 - acc: 0.9975 - ETA: 14s - loss: 0.0064 - acc: 0.9976 - ETA: 14s - loss: 0.0063 - acc: 0.9977 - ETA: 14s - loss: 0.0060 - acc: 0.9978 - ETA: 14s - loss: 0.0059 - acc: 0.9979 - ETA: 14s - loss: 0.0089 - acc: 0.9960 - ETA: 14s - loss: 0.0086 - acc: 0.9962 - ETA: 14s - loss: 0.0081 - acc: 0.9964 - ETA: 13s - loss: 0.0076 - acc: 0.9967 - ETA: 13s - loss: 0.0074 - acc: 0.9968 - ETA: 13s - loss: 0.0069 - acc: 0.9970 - ETA: 13s - loss: 0.0067 - acc: 0.9971 - ETA: 13s - loss: 0.0064 - acc: 0.9972 - ETA: 13s - loss: 0.0062 - acc: 0.9973 - ETA: 13s - loss: 0.0061 - acc: 0.9974 - ETA: 13s - loss: 0.0059 - acc: 0.9974 - ETA: 12s - loss: 0.0059 - acc: 0.9976 - ETA: 12s - loss: 0.0058 - acc: 0.9976 - ETA: 12s - loss: 0.0094 - acc: 0.9966 - ETA: 12s - loss: 0.0092 - acc: 0.9967 - ETA: 12s - loss: 0.0090 - acc: 0.9967 - ETA: 12s - loss: 0.0088 - acc: 0.9968 - ETA: 12s - loss: 0.0086 - acc: 0.9969 - ETA: 12s - loss: 0.0085 - acc: 0.9969 - ETA: 12s - loss: 0.0083 - acc: 0.9970 - ETA: 12s - loss: 0.0081 - acc: 0.9971 - ETA: 12s - loss: 0.0080 - acc: 0.9971 - ETA: 12s - loss: 0.0077 - acc: 0.9972 - ETA: 12s - loss: 0.0076 - acc: 0.9973 - ETA: 12s - loss: 0.0075 - acc: 0.9973 - ETA: 12s - loss: 0.0074 - acc: 0.9974 - ETA: 12s - loss: 0.0073 - acc: 0.9974 - ETA: 12s - loss: 0.0072 - acc: 0.9975 - ETA: 12s - loss: 0.0071 - acc: 0.9975 - ETA: 12s - loss: 0.0076 - acc: 0.9967 - ETA: 12s - loss: 0.0075 - acc: 0.9968 - ETA: 12s - loss: 0.0072 - acc: 0.9969 - ETA: 12s - loss: 0.0071 - acc: 0.9969 - ETA: 12s - loss: 0.0070 - acc: 0.9970 - ETA: 12s - loss: 0.0068 - acc: 0.9971 - ETA: 11s - loss: 0.0067 - acc: 0.9971 - ETA: 11s - loss: 0.0067 - acc: 0.9971 - ETA: 11s - loss: 0.0066 - acc: 0.9972 - ETA: 11s - loss: 0.0070 - acc: 0.9966 - ETA: 11s - loss: 0.0068 - acc: 0.9967 - ETA: 11s - loss: 0.0067 - acc: 0.9967 - ETA: 11s - loss: 0.0066 - acc: 0.9968 - ETA: 11s - loss: 0.0065 - acc: 0.9969 - ETA: 11s - loss: 0.0064 - acc: 0.9969 - ETA: 11s - loss: 0.0063 - acc: 0.9970 - ETA: 11s - loss: 0.0063 - acc: 0.9970 - ETA: 11s - loss: 0.0062 - acc: 0.9970 - ETA: 10s - loss: 0.0061 - acc: 0.9971 - ETA: 10s - loss: 0.0088 - acc: 0.9966 - ETA: 10s - loss: 0.0087 - acc: 0.9967 - ETA: 10s - loss: 0.0086 - acc: 0.9967 - ETA: 10s - loss: 0.0086 - acc: 0.9967 - ETA: 10s - loss: 0.0085 - acc: 0.9968 - ETA: 10s - loss: 0.0084 - acc: 0.9968 - ETA: 10s - loss: 0.0083 - acc: 0.9969 - ETA: 10s - loss: 0.0082 - acc: 0.9969 - ETA: 10s - loss: 0.0080 - acc: 0.9970 - ETA: 10s - loss: 0.0080 - acc: 0.9971 - ETA: 10s - loss: 0.0079 - acc: 0.9971 - ETA: 9s - loss: 0.0078 - acc: 0.9971  - ETA: 9s - loss: 0.0077 - acc: 0.9972 - ETA: 9s - loss: 0.0077 - acc: 0.9972 - ETA: 9s - loss: 0.0076 - acc: 0.9972 - ETA: 9s - loss: 0.0075 - acc: 0.9973 - ETA: 9s - loss: 0.0081 - acc: 0.9969 - ETA: 9s - loss: 0.0081 - acc: 0.9969 - ETA: 9s - loss: 0.0079 - acc: 0.9970 - ETA: 9s - loss: 0.0078 - acc: 0.9970 - ETA: 9s - loss: 0.0084 - acc: 0.9966 - ETA: 9s - loss: 0.0084 - acc: 0.9966 - ETA: 9s - loss: 0.0083 - acc: 0.9967 - ETA: 9s - loss: 0.0082 - acc: 0.9967 - ETA: 9s - loss: 0.0081 - acc: 0.9967 - ETA: 8s - loss: 0.0080 - acc: 0.9968 - ETA: 8s - loss: 0.0079 - acc: 0.9969 - ETA: 8s - loss: 0.0078 - acc: 0.9969 - ETA: 8s - loss: 0.0080 - acc: 0.9969 - ETA: 8s - loss: 0.0079 - acc: 0.9970 - ETA: 8s - loss: 0.0078 - acc: 0.9970 - ETA: 8s - loss: 0.0078 - acc: 0.9970 - ETA: 8s - loss: 0.0077 - acc: 0.9970 - ETA: 8s - loss: 0.0077 - acc: 0.9971 - ETA: 8s - loss: 0.0076 - acc: 0.9971 - ETA: 8s - loss: 0.0076 - acc: 0.9971 - ETA: 8s - loss: 0.0078 - acc: 0.9971 - ETA: 8s - loss: 0.0077 - acc: 0.9971 - ETA: 8s - loss: 0.0077 - acc: 0.9972 - ETA: 8s - loss: 0.0076 - acc: 0.9972 - ETA: 8s - loss: 0.0082 - acc: 0.9969 - ETA: 8s - loss: 0.0082 - acc: 0.9969 - ETA: 8s - loss: 0.0082 - acc: 0.9969 - ETA: 8s - loss: 0.0081 - acc: 0.9969 - ETA: 8s - loss: 0.0081 - acc: 0.9969 - ETA: 8s - loss: 0.0080 - acc: 0.9970 - ETA: 8s - loss: 0.0080 - acc: 0.9970 - ETA: 8s - loss: 0.0080 - acc: 0.9970 - ETA: 8s - loss: 0.0079 - acc: 0.9971 - ETA: 8s - loss: 0.0079 - acc: 0.9971 - ETA: 8s - loss: 0.0078 - acc: 0.9971 - ETA: 8s - loss: 0.0078 - acc: 0.9971 - ETA: 8s - loss: 0.0078 - acc: 0.9971 - ETA: 7s - loss: 0.0077 - acc: 0.9972 - ETA: 7s - loss: 0.0077 - acc: 0.9972 - ETA: 7s - loss: 0.0076 - acc: 0.9972 - ETA: 7s - loss: 0.0076 - acc: 0.9972 - ETA: 7s - loss: 0.0076 - acc: 0.9972 - ETA: 7s - loss: 0.0075 - acc: 0.9972 - ETA: 7s - loss: 0.0075 - acc: 0.9973 - ETA: 7s - loss: 0.0074 - acc: 0.9973 - ETA: 7s - loss: 0.0074 - acc: 0.9973 - ETA: 7s - loss: 0.0074 - acc: 0.9973 - ETA: 7s - loss: 0.0073 - acc: 0.9973 - ETA: 7s - loss: 0.0073 - acc: 0.9973 - ETA: 7s - loss: 0.0072 - acc: 0.9974 - ETA: 7s - loss: 0.0072 - acc: 0.9974 - ETA: 7s - loss: 0.0072 - acc: 0.9974 - ETA: 7s - loss: 0.0071 - acc: 0.9974 - ETA: 7s - loss: 0.0071 - acc: 0.9974 - ETA: 7s - loss: 0.0070 - acc: 0.9974 - ETA: 7s - loss: 0.0070 - acc: 0.9974 - ETA: 7s - loss: 0.0070 - acc: 0.9975 - ETA: 7s - loss: 0.0070 - acc: 0.9975 - ETA: 7s - loss: 0.0069 - acc: 0.9975 - ETA: 7s - loss: 0.0069 - acc: 0.9975 - ETA: 7s - loss: 0.0069 - acc: 0.9975 - ETA: 7s - loss: 0.0068 - acc: 0.9975 - ETA: 7s - loss: 0.0068 - acc: 0.9975 - ETA: 7s - loss: 0.0068 - acc: 0.9976 - ETA: 7s - loss: 0.0068 - acc: 0.9976 - ETA: 7s - loss: 0.0067 - acc: 0.9976 - ETA: 7s - loss: 0.0067 - acc: 0.9976 - ETA: 7s - loss: 0.0067 - acc: 0.9976 - ETA: 7s - loss: 0.0067 - acc: 0.9976 - ETA: 7s - loss: 0.0066 - acc: 0.9976 - ETA: 7s - loss: 0.0066 - acc: 0.9976 - ETA: 7s - loss: 0.0066 - acc: 0.9977 - ETA: 7s - loss: 0.0065 - acc: 0.9977 - ETA: 7s - loss: 0.0065 - acc: 0.9977 - ETA: 7s - loss: 0.0065 - acc: 0.9977 - ETA: 7s - loss: 0.0065 - acc: 0.9977 - ETA: 6s - loss: 0.0064 - acc: 0.9977 - ETA: 6s - loss: 0.0064 - acc: 0.9977 - ETA: 6s - loss: 0.0064 - acc: 0.9977 - ETA: 6s - loss: 0.0064 - acc: 0.9977 - ETA: 6s - loss: 0.0063 - acc: 0.9978 - ETA: 6s - loss: 0.0063 - acc: 0.9978 - ETA: 6s - loss: 0.0063 - acc: 0.9978 - ETA: 6s - loss: 0.0063 - acc: 0.9978 - ETA: 6s - loss: 0.0062 - acc: 0.9978 - ETA: 6s - loss: 0.0062 - acc: 0.9978 - ETA: 6s - loss: 0.0062 - acc: 0.9978 - ETA: 6s - loss: 0.0062 - acc: 0.9978 - ETA: 6s - loss: 0.0062 - acc: 0.9978 - ETA: 6s - loss: 0.0061 - acc: 0.9979 - ETA: 6s - loss: 0.0061 - acc: 0.9979 - ETA: 6s - loss: 0.0061 - acc: 0.9979 - ETA: 6s - loss: 0.0060 - acc: 0.9979 - ETA: 6s - loss: 0.0060 - acc: 0.9979 - ETA: 6s - loss: 0.0060 - acc: 0.9979 - ETA: 6s - loss: 0.0060 - acc: 0.9979 - ETA: 6s - loss: 0.0060 - acc: 0.9979 - ETA: 6s - loss: 0.0060 - acc: 0.9979 - ETA: 5s - loss: 0.0060 - acc: 0.9979 - ETA: 5s - loss: 0.0060 - acc: 0.9980 - ETA: 5s - loss: 0.0059 - acc: 0.9980 - ETA: 5s - loss: 0.0059 - acc: 0.9980 - ETA: 5s - loss: 0.0059 - acc: 0.9980 - ETA: 5s - loss: 0.0059 - acc: 0.9980 - ETA: 5s - loss: 0.0058 - acc: 0.9980 - ETA: 5s - loss: 0.0058 - acc: 0.9980 - ETA: 5s - loss: 0.0058 - acc: 0.9980 - ETA: 5s - loss: 0.0058 - acc: 0.9980 - ETA: 5s - loss: 0.0058 - acc: 0.9980 - ETA: 5s - loss: 0.0057 - acc: 0.9980 - ETA: 5s - loss: 0.0058 - acc: 0.9981 - ETA: 5s - loss: 0.0058 - acc: 0.9981 - ETA: 5s - loss: 0.0057 - acc: 0.9981 - ETA: 5s - loss: 0.0057 - acc: 0.9981 - ETA: 5s - loss: 0.0057 - acc: 0.9981 - ETA: 4s - loss: 0.0057 - acc: 0.9981 - ETA: 4s - loss: 0.0057 - acc: 0.9981 - ETA: 4s - loss: 0.0056 - acc: 0.9981 - ETA: 4s - loss: 0.0056 - acc: 0.9981 - ETA: 4s - loss: 0.0056 - acc: 0.9981 - ETA: 4s - loss: 0.0055 - acc: 0.9982 - ETA: 4s - loss: 0.0055 - acc: 0.9982 - ETA: 4s - loss: 0.0055 - acc: 0.9982 - ETA: 4s - loss: 0.0055 - acc: 0.9982 - ETA: 4s - loss: 0.0055 - acc: 0.9982 - ETA: 4s - loss: 0.0056 - acc: 0.9980 - ETA: 4s - loss: 0.0055 - acc: 0.9980 - ETA: 4s - loss: 0.0055 - acc: 0.9980 - ETA: 3s - loss: 0.0055 - acc: 0.9981 - ETA: 3s - loss: 0.0054 - acc: 0.9981 - ETA: 3s - loss: 0.0054 - acc: 0.9981 - ETA: 3s - loss: 0.0054 - acc: 0.9981 - ETA: 3s - loss: 0.0054 - acc: 0.9981 - ETA: 3s - loss: 0.0053 - acc: 0.9981 - ETA: 3s - loss: 0.0053 - acc: 0.9981 - ETA: 3s - loss: 0.0053 - acc: 0.9981 - ETA: 3s - loss: 0.0052 - acc: 0.9982 - ETA: 3s - loss: 0.0052 - acc: 0.9982 - ETA: 2s - loss: 0.0052 - acc: 0.9982 - ETA: 2s - loss: 0.0051 - acc: 0.9982 - ETA: 2s - loss: 0.0051 - acc: 0.9982 - ETA: 2s - loss: 0.0051 - acc: 0.9982 - ETA: 2s - loss: 0.0051 - acc: 0.9982 - ETA: 2s - loss: 0.0052 - acc: 0.9982 - ETA: 2s - loss: 0.0054 - acc: 0.9981 - ETA: 2s - loss: 0.0054 - acc: 0.9981 - ETA: 2s - loss: 0.0054 - acc: 0.9981 - ETA: 2s - loss: 0.0054 - acc: 0.9981 - ETA: 2s - loss: 0.0053 - acc: 0.9981 - ETA: 2s - loss: 0.0053 - acc: 0.9981 - ETA: 2s - loss: 0.0053 - acc: 0.9981 - ETA: 2s - loss: 0.0053 - acc: 0.9981 - ETA: 2s - loss: 0.0053 - acc: 0.9981 - ETA: 1s - loss: 0.0053 - acc: 0.9981 - ETA: 1s - loss: 0.0053 - acc: 0.9981 - ETA: 1s - loss: 0.0053 - acc: 0.9981 - ETA: 1s - loss: 0.0053 - acc: 0.9981 - ETA: 1s - loss: 0.0053 - acc: 0.9982 - ETA: 1s - loss: 0.0053 - acc: 0.9982 - ETA: 1s - loss: 0.0052 - acc: 0.9982 - ETA: 1s - loss: 0.0052 - acc: 0.9982 - ETA: 1s - loss: 0.0057 - acc: 0.9980 - ETA: 1s - loss: 0.0058 - acc: 0.9980 - ETA: 1s - loss: 0.0057 - acc: 0.9980 - ETA: 1s - loss: 0.0057 - acc: 0.9980 - ETA: 1s - loss: 0.0057 - acc: 0.9981 - ETA: 1s - loss: 0.0057 - acc: 0.9981 - ETA: 1s - loss: 0.0057 - acc: 0.9981 - ETA: 1s - loss: 0.0056 - acc: 0.9981 - ETA: 1s - loss: 0.0056 - acc: 0.9981 - ETA: 0s - loss: 0.0056 - acc: 0.9981 - ETA: 0s - loss: 0.0056 - acc: 0.9981 - ETA: 0s - loss: 0.0056 - acc: 0.9981 - ETA: 0s - loss: 0.0056 - acc: 0.9981 - ETA: 0s - loss: 0.0056 - acc: 0.9981 - ETA: 0s - loss: 0.0056 - acc: 0.9981 - ETA: 0s - loss: 0.0056 - acc: 0.9981 - ETA: 0s - loss: 0.0056 - acc: 0.9981 - ETA: 0s - loss: 0.0058 - acc: 0.9980 - ETA: 0s - loss: 0.0058 - acc: 0.9980 - ETA: 0s - loss: 0.0058 - acc: 0.9980 - ETA: 0s - loss: 0.0058 - acc: 0.9980 - ETA: 0s - loss: 0.0058 - acc: 0.9980 - ETA: 0s - loss: 0.0058 - acc: 0.9980 - ETA: 0s - loss: 0.0058 - acc: 0.9980 - ETA: 0s - loss: 0.0058 - acc: 0.9980 - ETA: 0s - loss: 0.0058 - acc: 0.9980Epoch 00017: val_loss did not improve
6680/6680 [==============================] - 16s - loss: 0.0057 - acc: 0.9981 - val_loss: 0.9001 - val_acc: 0.8335
Epoch 19/20
6660/6680 [============================>.] - ETA: 9s - loss: 8.1584e-05 - acc: 1.0000 - ETA: 13s - loss: 1.3967e-04 - acc: 1.0000 - ETA: 15s - loss: 1.5305e-04 - acc: 1.0000 - ETA: 15s - loss: 1.6473e-04 - acc: 1.0000 - ETA: 15s - loss: 0.0750 - acc: 0.9900     - ETA: 15s - loss: 0.0628 - acc: 0.9917 - ETA: 14s - loss: 0.0476 - acc: 0.9937 - ETA: 14s - loss: 0.0427 - acc: 0.9944 - ETA: 14s - loss: 0.0385 - acc: 0.9950 - ETA: 14s - loss: 0.0350 - acc: 0.9955 - ETA: 15s - loss: 0.0321 - acc: 0.9958 - ETA: 16s - loss: 0.0297 - acc: 0.9962 - ETA: 16s - loss: 0.0276 - acc: 0.9964 - ETA: 15s - loss: 0.0242 - acc: 0.9969 - ETA: 15s - loss: 0.0228 - acc: 0.9971 - ETA: 15s - loss: 0.0215 - acc: 0.9972 - ETA: 14s - loss: 0.0196 - acc: 0.9975 - ETA: 14s - loss: 0.0187 - acc: 0.9976 - ETA: 14s - loss: 0.0179 - acc: 0.9977 - ETA: 15s - loss: 0.0173 - acc: 0.9978 - ETA: 14s - loss: 0.0166 - acc: 0.9979 - ETA: 15s - loss: 0.0160 - acc: 0.9980 - ETA: 15s - loss: 0.0154 - acc: 0.9981 - ETA: 15s - loss: 0.0150 - acc: 0.9981 - ETA: 14s - loss: 0.0144 - acc: 0.9982 - ETA: 15s - loss: 0.0139 - acc: 0.9983 - ETA: 14s - loss: 0.0135 - acc: 0.9983 - ETA: 14s - loss: 0.0131 - acc: 0.9984 - ETA: 14s - loss: 0.0127 - acc: 0.9984 - ETA: 14s - loss: 0.0123 - acc: 0.9985 - ETA: 14s - loss: 0.0117 - acc: 0.9986 - ETA: 14s - loss: 0.0111 - acc: 0.9986 - ETA: 14s - loss: 0.0108 - acc: 0.9987 - ETA: 14s - loss: 0.0105 - acc: 0.9987 - ETA: 14s - loss: 0.0102 - acc: 0.9987 - ETA: 14s - loss: 0.0100 - acc: 0.9988 - ETA: 14s - loss: 0.0098 - acc: 0.9988 - ETA: 14s - loss: 0.0095 - acc: 0.9988 - ETA: 14s - loss: 0.0093 - acc: 0.9989 - ETA: 14s - loss: 0.0091 - acc: 0.9989 - ETA: 14s - loss: 0.0089 - acc: 0.9989 - ETA: 14s - loss: 0.0089 - acc: 0.9989 - ETA: 14s - loss: 0.0087 - acc: 0.9990 - ETA: 14s - loss: 0.0085 - acc: 0.9990 - ETA: 14s - loss: 0.0084 - acc: 0.9990 - ETA: 14s - loss: 0.0082 - acc: 0.9990 - ETA: 14s - loss: 0.0088 - acc: 0.9981 - ETA: 14s - loss: 0.0087 - acc: 0.9981 - ETA: 14s - loss: 0.0085 - acc: 0.9981 - ETA: 14s - loss: 0.0083 - acc: 0.9982 - ETA: 14s - loss: 0.0082 - acc: 0.9982 - ETA: 14s - loss: 0.0081 - acc: 0.9982 - ETA: 14s - loss: 0.0080 - acc: 0.9983 - ETA: 14s - loss: 0.0078 - acc: 0.9983 - ETA: 14s - loss: 0.0077 - acc: 0.9983 - ETA: 14s - loss: 0.0076 - acc: 0.9984 - ETA: 14s - loss: 0.0075 - acc: 0.9984 - ETA: 14s - loss: 0.0073 - acc: 0.9984 - ETA: 14s - loss: 0.0072 - acc: 0.9984 - ETA: 14s - loss: 0.0071 - acc: 0.9985 - ETA: 14s - loss: 0.0070 - acc: 0.9985 - ETA: 14s - loss: 0.0069 - acc: 0.9985 - ETA: 14s - loss: 0.0068 - acc: 0.9985 - ETA: 14s - loss: 0.0067 - acc: 0.9986 - ETA: 14s - loss: 0.0067 - acc: 0.9986 - ETA: 14s - loss: 0.0066 - acc: 0.9986 - ETA: 14s - loss: 0.0064 - acc: 0.9986 - ETA: 13s - loss: 0.0063 - acc: 0.9986 - ETA: 13s - loss: 0.0064 - acc: 0.9987 - ETA: 13s - loss: 0.0064 - acc: 0.9987 - ETA: 13s - loss: 0.0062 - acc: 0.9987 - ETA: 13s - loss: 0.0062 - acc: 0.9987 - ETA: 13s - loss: 0.0061 - acc: 0.9987 - ETA: 13s - loss: 0.0060 - acc: 0.9988 - ETA: 13s - loss: 0.0059 - acc: 0.9988 - ETA: 12s - loss: 0.0059 - acc: 0.9988 - ETA: 12s - loss: 0.0059 - acc: 0.9989 - ETA: 12s - loss: 0.0058 - acc: 0.9989 - ETA: 12s - loss: 0.0057 - acc: 0.9989 - ETA: 12s - loss: 0.0057 - acc: 0.9989 - ETA: 12s - loss: 0.0056 - acc: 0.9989 - ETA: 12s - loss: 0.0055 - acc: 0.9989 - ETA: 12s - loss: 0.0055 - acc: 0.9989 - ETA: 12s - loss: 0.0054 - acc: 0.9990 - ETA: 12s - loss: 0.0054 - acc: 0.9990 - ETA: 11s - loss: 0.0053 - acc: 0.9990 - ETA: 11s - loss: 0.0052 - acc: 0.9990 - ETA: 11s - loss: 0.0051 - acc: 0.9990 - ETA: 11s - loss: 0.0050 - acc: 0.9990 - ETA: 11s - loss: 0.0049 - acc: 0.9991 - ETA: 11s - loss: 0.0048 - acc: 0.9991 - ETA: 11s - loss: 0.0048 - acc: 0.9991 - ETA: 10s - loss: 0.0050 - acc: 0.9991 - ETA: 10s - loss: 0.0050 - acc: 0.9991 - ETA: 10s - loss: 0.0049 - acc: 0.9991 - ETA: 10s - loss: 0.0048 - acc: 0.9991 - ETA: 10s - loss: 0.0048 - acc: 0.9992 - ETA: 10s - loss: 0.0047 - acc: 0.9992 - ETA: 10s - loss: 0.0047 - acc: 0.9992 - ETA: 10s - loss: 0.0047 - acc: 0.9992 - ETA: 10s - loss: 0.0047 - acc: 0.9992 - ETA: 10s - loss: 0.0046 - acc: 0.9992 - ETA: 10s - loss: 0.0046 - acc: 0.9992 - ETA: 10s - loss: 0.0045 - acc: 0.9992 - ETA: 10s - loss: 0.0045 - acc: 0.9992 - ETA: 9s - loss: 0.0045 - acc: 0.9992  - ETA: 9s - loss: 0.0045 - acc: 0.9992 - ETA: 9s - loss: 0.0044 - acc: 0.9992 - ETA: 9s - loss: 0.0044 - acc: 0.9992 - ETA: 9s - loss: 0.0044 - acc: 0.9993 - ETA: 9s - loss: 0.0043 - acc: 0.9993 - ETA: 9s - loss: 0.0043 - acc: 0.9993 - ETA: 9s - loss: 0.0057 - acc: 0.9989 - ETA: 9s - loss: 0.0057 - acc: 0.9989 - ETA: 9s - loss: 0.0073 - acc: 0.9986 - ETA: 9s - loss: 0.0072 - acc: 0.9986 - ETA: 8s - loss: 0.0072 - acc: 0.9986 - ETA: 8s - loss: 0.0071 - acc: 0.9986 - ETA: 8s - loss: 0.0070 - acc: 0.9986 - ETA: 8s - loss: 0.0069 - acc: 0.9987 - ETA: 8s - loss: 0.0069 - acc: 0.9987 - ETA: 8s - loss: 0.0068 - acc: 0.9987 - ETA: 8s - loss: 0.0068 - acc: 0.9987 - ETA: 8s - loss: 0.0067 - acc: 0.9987 - ETA: 8s - loss: 0.0066 - acc: 0.9987 - ETA: 8s - loss: 0.0066 - acc: 0.9987 - ETA: 7s - loss: 0.0065 - acc: 0.9988 - ETA: 7s - loss: 0.0065 - acc: 0.9988 - ETA: 7s - loss: 0.0064 - acc: 0.9988 - ETA: 7s - loss: 0.0064 - acc: 0.9988 - ETA: 7s - loss: 0.0064 - acc: 0.9988 - ETA: 7s - loss: 0.0063 - acc: 0.9988 - ETA: 7s - loss: 0.0063 - acc: 0.9988 - ETA: 7s - loss: 0.0062 - acc: 0.9988 - ETA: 7s - loss: 0.0062 - acc: 0.9988 - ETA: 7s - loss: 0.0061 - acc: 0.9988 - ETA: 7s - loss: 0.0061 - acc: 0.9989 - ETA: 7s - loss: 0.0060 - acc: 0.9989 - ETA: 7s - loss: 0.0060 - acc: 0.9989 - ETA: 7s - loss: 0.0060 - acc: 0.9989 - ETA: 6s - loss: 0.0059 - acc: 0.9989 - ETA: 6s - loss: 0.0059 - acc: 0.9989 - ETA: 6s - loss: 0.0058 - acc: 0.9989 - ETA: 6s - loss: 0.0059 - acc: 0.9989 - ETA: 6s - loss: 0.0058 - acc: 0.9989 - ETA: 6s - loss: 0.0058 - acc: 0.9989 - ETA: 6s - loss: 0.0058 - acc: 0.9989 - ETA: 6s - loss: 0.0057 - acc: 0.9990 - ETA: 6s - loss: 0.0057 - acc: 0.9990 - ETA: 6s - loss: 0.0056 - acc: 0.9990 - ETA: 6s - loss: 0.0056 - acc: 0.9990 - ETA: 6s - loss: 0.0056 - acc: 0.9990 - ETA: 6s - loss: 0.0056 - acc: 0.9990 - ETA: 5s - loss: 0.0055 - acc: 0.9990 - ETA: 5s - loss: 0.0055 - acc: 0.9990 - ETA: 5s - loss: 0.0058 - acc: 0.9988 - ETA: 5s - loss: 0.0059 - acc: 0.9986 - ETA: 5s - loss: 0.0058 - acc: 0.9986 - ETA: 5s - loss: 0.0059 - acc: 0.9986 - ETA: 5s - loss: 0.0058 - acc: 0.9986 - ETA: 5s - loss: 0.0061 - acc: 0.9984 - ETA: 5s - loss: 0.0060 - acc: 0.9984 - ETA: 5s - loss: 0.0060 - acc: 0.9984 - ETA: 5s - loss: 0.0060 - acc: 0.9984 - ETA: 4s - loss: 0.0059 - acc: 0.9984 - ETA: 4s - loss: 0.0059 - acc: 0.9984 - ETA: 4s - loss: 0.0058 - acc: 0.9984 - ETA: 4s - loss: 0.0058 - acc: 0.9984 - ETA: 4s - loss: 0.0058 - acc: 0.9985 - ETA: 4s - loss: 0.0058 - acc: 0.9985 - ETA: 4s - loss: 0.0057 - acc: 0.9985 - ETA: 4s - loss: 0.0057 - acc: 0.9985 - ETA: 4s - loss: 0.0068 - acc: 0.9983 - ETA: 4s - loss: 0.0067 - acc: 0.9983 - ETA: 4s - loss: 0.0067 - acc: 0.9983 - ETA: 4s - loss: 0.0070 - acc: 0.9981 - ETA: 4s - loss: 0.0070 - acc: 0.9981 - ETA: 4s - loss: 0.0070 - acc: 0.9981 - ETA: 4s - loss: 0.0069 - acc: 0.9981 - ETA: 4s - loss: 0.0069 - acc: 0.9981 - ETA: 4s - loss: 0.0068 - acc: 0.9981 - ETA: 3s - loss: 0.0069 - acc: 0.9982 - ETA: 3s - loss: 0.0069 - acc: 0.9982 - ETA: 3s - loss: 0.0068 - acc: 0.9982 - ETA: 3s - loss: 0.0068 - acc: 0.9982 - ETA: 3s - loss: 0.0068 - acc: 0.9982 - ETA: 3s - loss: 0.0067 - acc: 0.9982 - ETA: 3s - loss: 0.0068 - acc: 0.9982 - ETA: 3s - loss: 0.0070 - acc: 0.9980 - ETA: 3s - loss: 0.0069 - acc: 0.9980 - ETA: 3s - loss: 0.0069 - acc: 0.9981 - ETA: 3s - loss: 0.0069 - acc: 0.9981 - ETA: 3s - loss: 0.0068 - acc: 0.9981 - ETA: 3s - loss: 0.0068 - acc: 0.9981 - ETA: 3s - loss: 0.0068 - acc: 0.9981 - ETA: 2s - loss: 0.0068 - acc: 0.9981 - ETA: 2s - loss: 0.0067 - acc: 0.9981 - ETA: 2s - loss: 0.0067 - acc: 0.9981 - ETA: 2s - loss: 0.0067 - acc: 0.9981 - ETA: 2s - loss: 0.0067 - acc: 0.9982 - ETA: 2s - loss: 0.0066 - acc: 0.9982 - ETA: 2s - loss: 0.0066 - acc: 0.9982 - ETA: 2s - loss: 0.0065 - acc: 0.9982 - ETA: 2s - loss: 0.0065 - acc: 0.9982 - ETA: 2s - loss: 0.0065 - acc: 0.9982 - ETA: 2s - loss: 0.0065 - acc: 0.9982 - ETA: 2s - loss: 0.0065 - acc: 0.9982 - ETA: 2s - loss: 0.0065 - acc: 0.9982 - ETA: 2s - loss: 0.0064 - acc: 0.9982 - ETA: 2s - loss: 0.0064 - acc: 0.9983 - ETA: 1s - loss: 0.0065 - acc: 0.9981 - ETA: 1s - loss: 0.0065 - acc: 0.9981 - ETA: 1s - loss: 0.0065 - acc: 0.9981 - ETA: 1s - loss: 0.0064 - acc: 0.9981 - ETA: 1s - loss: 0.0064 - acc: 0.9981 - ETA: 1s - loss: 0.0064 - acc: 0.9982 - ETA: 1s - loss: 0.0063 - acc: 0.9982 - ETA: 1s - loss: 0.0063 - acc: 0.9982 - ETA: 1s - loss: 0.0063 - acc: 0.9982 - ETA: 1s - loss: 0.0062 - acc: 0.9982 - ETA: 1s - loss: 0.0062 - acc: 0.9982 - ETA: 1s - loss: 0.0062 - acc: 0.9982 - ETA: 1s - loss: 0.0062 - acc: 0.9982 - ETA: 1s - loss: 0.0063 - acc: 0.9982 - ETA: 1s - loss: 0.0063 - acc: 0.9982 - ETA: 0s - loss: 0.0063 - acc: 0.9982 - ETA: 0s - loss: 0.0062 - acc: 0.9982 - ETA: 0s - loss: 0.0062 - acc: 0.9982 - ETA: 0s - loss: 0.0064 - acc: 0.9981 - ETA: 0s - loss: 0.0063 - acc: 0.9981 - ETA: 0s - loss: 0.0063 - acc: 0.9981 - ETA: 0s - loss: 0.0063 - acc: 0.9981 - ETA: 0s - loss: 0.0062 - acc: 0.9981 - ETA: 0s - loss: 0.0062 - acc: 0.9981 - ETA: 0s - loss: 0.0062 - acc: 0.9982 - ETA: 0s - loss: 0.0062 - acc: 0.9982 - ETA: 0s - loss: 0.0061 - acc: 0.9982 - ETA: 0s - loss: 0.0061 - acc: 0.9982 - ETA: 0s - loss: 0.0061 - acc: 0.9982Epoch 00018: val_loss did not improve
6680/6680 [==============================] - 14s - loss: 0.0061 - acc: 0.9982 - val_loss: 0.8774 - val_acc: 0.8299
Epoch 20/20
6660/6680 [============================>.] - ETA: 6s - loss: 4.5545e-04 - acc: 1.0000 - ETA: 8s - loss: 2.9874e-04 - acc: 1.0000 - ETA: 10s - loss: 2.4301e-04 - acc: 1.0000 - ETA: 10s - loss: 2.8160e-04 - acc: 1.0000 - ETA: 10s - loss: 0.0010 - acc: 1.0000     - ETA: 11s - loss: 9.1626e-04 - acc: 1.0000 - ETA: 11s - loss: 0.0013 - acc: 1.0000     - ETA: 10s - loss: 0.0012 - acc: 1.0000 - ETA: 11s - loss: 0.0011 - acc: 1.0000 - ETA: 11s - loss: 0.0011 - acc: 1.0000 - ETA: 11s - loss: 0.0010 - acc: 1.0000 - ETA: 11s - loss: 9.3540e-04 - acc: 1.0000 - ETA: 11s - loss: 9.2634e-04 - acc: 1.0000 - ETA: 11s - loss: 8.8126e-04 - acc: 1.0000 - ETA: 11s - loss: 8.8740e-04 - acc: 1.0000 - ETA: 12s - loss: 0.0012 - acc: 1.0000     - ETA: 12s - loss: 0.0012 - acc: 1.0000 - ETA: 12s - loss: 0.0067 - acc: 0.9979 - ETA: 12s - loss: 0.0067 - acc: 0.9980 - ETA: 12s - loss: 0.0065 - acc: 0.9981 - ETA: 12s - loss: 0.0063 - acc: 0.9981 - ETA: 12s - loss: 0.0059 - acc: 0.9983 - ETA: 12s - loss: 0.0056 - acc: 0.9984 - ETA: 11s - loss: 0.0053 - acc: 0.9985 - ETA: 11s - loss: 0.0050 - acc: 0.9986 - ETA: 11s - loss: 0.0052 - acc: 0.9986 - ETA: 11s - loss: 0.0050 - acc: 0.9987 - ETA: 11s - loss: 0.0048 - acc: 0.9987 - ETA: 11s - loss: 0.0048 - acc: 0.9988 - ETA: 11s - loss: 0.0046 - acc: 0.9988 - ETA: 11s - loss: 0.0044 - acc: 0.9989 - ETA: 11s - loss: 0.0043 - acc: 0.9989 - ETA: 11s - loss: 0.0042 - acc: 0.9989 - ETA: 11s - loss: 0.0041 - acc: 0.9990 - ETA: 11s - loss: 0.0040 - acc: 0.9990 - ETA: 11s - loss: 0.0040 - acc: 0.9990 - ETA: 11s - loss: 0.0039 - acc: 0.9990 - ETA: 11s - loss: 0.0038 - acc: 0.9991 - ETA: 11s - loss: 0.0083 - acc: 0.9982 - ETA: 11s - loss: 0.0081 - acc: 0.9982 - ETA: 10s - loss: 0.0079 - acc: 0.9983 - ETA: 10s - loss: 0.0076 - acc: 0.9983 - ETA: 10s - loss: 0.0075 - acc: 0.9984 - ETA: 10s - loss: 0.0074 - acc: 0.9984 - ETA: 10s - loss: 0.0072 - acc: 0.9984 - ETA: 10s - loss: 0.0070 - acc: 0.9985 - ETA: 10s - loss: 0.0069 - acc: 0.9985 - ETA: 10s - loss: 0.0068 - acc: 0.9985 - ETA: 10s - loss: 0.0067 - acc: 0.9986 - ETA: 10s - loss: 0.0065 - acc: 0.9986 - ETA: 10s - loss: 0.0063 - acc: 0.9986 - ETA: 10s - loss: 0.0062 - acc: 0.9987 - ETA: 10s - loss: 0.0061 - acc: 0.9987 - ETA: 9s - loss: 0.0059 - acc: 0.9987  - ETA: 9s - loss: 0.0059 - acc: 0.9987 - ETA: 9s - loss: 0.0057 - acc: 0.9988 - ETA: 9s - loss: 0.0057 - acc: 0.9988 - ETA: 9s - loss: 0.0055 - acc: 0.9988 - ETA: 9s - loss: 0.0054 - acc: 0.9989 - ETA: 9s - loss: 0.0053 - acc: 0.9989 - ETA: 9s - loss: 0.0053 - acc: 0.9989 - ETA: 9s - loss: 0.0052 - acc: 0.9989 - ETA: 9s - loss: 0.0051 - acc: 0.9989 - ETA: 9s - loss: 0.0051 - acc: 0.9989 - ETA: 9s - loss: 0.0050 - acc: 0.9990 - ETA: 9s - loss: 0.0049 - acc: 0.9990 - ETA: 9s - loss: 0.0048 - acc: 0.9990 - ETA: 9s - loss: 0.0048 - acc: 0.9990 - ETA: 8s - loss: 0.0047 - acc: 0.9990 - ETA: 8s - loss: 0.0046 - acc: 0.9990 - ETA: 8s - loss: 0.0046 - acc: 0.9990 - ETA: 8s - loss: 0.0046 - acc: 0.9991 - ETA: 8s - loss: 0.0045 - acc: 0.9991 - ETA: 8s - loss: 0.0044 - acc: 0.9991 - ETA: 8s - loss: 0.0044 - acc: 0.9991 - ETA: 8s - loss: 0.0043 - acc: 0.9991 - ETA: 8s - loss: 0.0044 - acc: 0.9991 - ETA: 8s - loss: 0.0044 - acc: 0.9991 - ETA: 8s - loss: 0.0043 - acc: 0.9991 - ETA: 8s - loss: 0.0043 - acc: 0.9992 - ETA: 8s - loss: 0.0043 - acc: 0.9992 - ETA: 8s - loss: 0.0042 - acc: 0.9992 - ETA: 8s - loss: 0.0042 - acc: 0.9992 - ETA: 7s - loss: 0.0041 - acc: 0.9992 - ETA: 7s - loss: 0.0041 - acc: 0.9992 - ETA: 7s - loss: 0.0040 - acc: 0.9992 - ETA: 7s - loss: 0.0040 - acc: 0.9992 - ETA: 7s - loss: 0.0039 - acc: 0.9992 - ETA: 7s - loss: 0.0039 - acc: 0.9993 - ETA: 7s - loss: 0.0038 - acc: 0.9993 - ETA: 7s - loss: 0.0038 - acc: 0.9993 - ETA: 7s - loss: 0.0037 - acc: 0.9993 - ETA: 7s - loss: 0.0037 - acc: 0.9993 - ETA: 7s - loss: 0.0037 - acc: 0.9993 - ETA: 7s - loss: 0.0037 - acc: 0.9993 - ETA: 7s - loss: 0.0037 - acc: 0.9993 - ETA: 7s - loss: 0.0037 - acc: 0.9993 - ETA: 7s - loss: 0.0036 - acc: 0.9993 - ETA: 7s - loss: 0.0036 - acc: 0.9993 - ETA: 7s - loss: 0.0036 - acc: 0.9993 - ETA: 7s - loss: 0.0036 - acc: 0.9993 - ETA: 7s - loss: 0.0036 - acc: 0.9993 - ETA: 6s - loss: 0.0035 - acc: 0.9994 - ETA: 6s - loss: 0.0035 - acc: 0.9994 - ETA: 6s - loss: 0.0035 - acc: 0.9994 - ETA: 6s - loss: 0.0035 - acc: 0.9994 - ETA: 6s - loss: 0.0034 - acc: 0.9994 - ETA: 6s - loss: 0.0034 - acc: 0.9994 - ETA: 6s - loss: 0.0036 - acc: 0.9991 - ETA: 6s - loss: 0.0039 - acc: 0.9988 - ETA: 6s - loss: 0.0038 - acc: 0.9988 - ETA: 6s - loss: 0.0038 - acc: 0.9988 - ETA: 6s - loss: 0.0038 - acc: 0.9988 - ETA: 6s - loss: 0.0038 - acc: 0.9988 - ETA: 6s - loss: 0.0038 - acc: 0.9989 - ETA: 6s - loss: 0.0037 - acc: 0.9989 - ETA: 6s - loss: 0.0037 - acc: 0.9989 - ETA: 5s - loss: 0.0037 - acc: 0.9989 - ETA: 5s - loss: 0.0036 - acc: 0.9989 - ETA: 5s - loss: 0.0036 - acc: 0.9989 - ETA: 5s - loss: 0.0036 - acc: 0.9989 - ETA: 5s - loss: 0.0036 - acc: 0.9989 - ETA: 5s - loss: 0.0035 - acc: 0.9989 - ETA: 5s - loss: 0.0035 - acc: 0.9989 - ETA: 5s - loss: 0.0035 - acc: 0.9990 - ETA: 5s - loss: 0.0035 - acc: 0.9990 - ETA: 5s - loss: 0.0043 - acc: 0.9987 - ETA: 5s - loss: 0.0043 - acc: 0.9987 - ETA: 5s - loss: 0.0043 - acc: 0.9987 - ETA: 5s - loss: 0.0043 - acc: 0.9987 - ETA: 5s - loss: 0.0042 - acc: 0.9987 - ETA: 5s - loss: 0.0042 - acc: 0.9988 - ETA: 4s - loss: 0.0042 - acc: 0.9988 - ETA: 4s - loss: 0.0042 - acc: 0.9988 - ETA: 4s - loss: 0.0041 - acc: 0.9988 - ETA: 4s - loss: 0.0057 - acc: 0.9986 - ETA: 4s - loss: 0.0056 - acc: 0.9986 - ETA: 4s - loss: 0.0056 - acc: 0.9986 - ETA: 4s - loss: 0.0057 - acc: 0.9986 - ETA: 4s - loss: 0.0056 - acc: 0.9986 - ETA: 4s - loss: 0.0056 - acc: 0.9986 - ETA: 4s - loss: 0.0055 - acc: 0.9986 - ETA: 4s - loss: 0.0055 - acc: 0.9986 - ETA: 4s - loss: 0.0055 - acc: 0.9986 - ETA: 4s - loss: 0.0054 - acc: 0.9987 - ETA: 4s - loss: 0.0054 - acc: 0.9987 - ETA: 3s - loss: 0.0054 - acc: 0.9987 - ETA: 3s - loss: 0.0053 - acc: 0.9987 - ETA: 3s - loss: 0.0053 - acc: 0.9987 - ETA: 3s - loss: 0.0053 - acc: 0.9987 - ETA: 3s - loss: 0.0053 - acc: 0.9987 - ETA: 3s - loss: 0.0053 - acc: 0.9987 - ETA: 3s - loss: 0.0053 - acc: 0.9987 - ETA: 3s - loss: 0.0052 - acc: 0.9987 - ETA: 3s - loss: 0.0052 - acc: 0.9987 - ETA: 3s - loss: 0.0052 - acc: 0.9987 - ETA: 3s - loss: 0.0052 - acc: 0.9987 - ETA: 3s - loss: 0.0051 - acc: 0.9988 - ETA: 3s - loss: 0.0051 - acc: 0.9988 - ETA: 3s - loss: 0.0051 - acc: 0.9988 - ETA: 3s - loss: 0.0051 - acc: 0.9988 - ETA: 3s - loss: 0.0050 - acc: 0.9988 - ETA: 3s - loss: 0.0055 - acc: 0.9986 - ETA: 3s - loss: 0.0055 - acc: 0.9986 - ETA: 3s - loss: 0.0054 - acc: 0.9986 - ETA: 3s - loss: 0.0054 - acc: 0.9986 - ETA: 2s - loss: 0.0054 - acc: 0.9986 - ETA: 2s - loss: 0.0054 - acc: 0.9986 - ETA: 2s - loss: 0.0053 - acc: 0.9986 - ETA: 2s - loss: 0.0053 - acc: 0.9987 - ETA: 2s - loss: 0.0053 - acc: 0.9987 - ETA: 2s - loss: 0.0053 - acc: 0.9987 - ETA: 2s - loss: 0.0052 - acc: 0.9987 - ETA: 2s - loss: 0.0055 - acc: 0.9985 - ETA: 2s - loss: 0.0055 - acc: 0.9985 - ETA: 2s - loss: 0.0055 - acc: 0.9985 - ETA: 2s - loss: 0.0054 - acc: 0.9985 - ETA: 2s - loss: 0.0054 - acc: 0.9985 - ETA: 2s - loss: 0.0054 - acc: 0.9985 - ETA: 2s - loss: 0.0053 - acc: 0.9986 - ETA: 2s - loss: 0.0053 - acc: 0.9986 - ETA: 2s - loss: 0.0053 - acc: 0.9986 - ETA: 1s - loss: 0.0053 - acc: 0.9986 - ETA: 1s - loss: 0.0052 - acc: 0.9986 - ETA: 1s - loss: 0.0052 - acc: 0.9986 - ETA: 1s - loss: 0.0052 - acc: 0.9986 - ETA: 1s - loss: 0.0052 - acc: 0.9986 - ETA: 1s - loss: 0.0054 - acc: 0.9984 - ETA: 1s - loss: 0.0054 - acc: 0.9985 - ETA: 1s - loss: 0.0054 - acc: 0.9985 - ETA: 1s - loss: 0.0053 - acc: 0.9985 - ETA: 1s - loss: 0.0053 - acc: 0.9985 - ETA: 1s - loss: 0.0053 - acc: 0.9985 - ETA: 1s - loss: 0.0053 - acc: 0.9985 - ETA: 1s - loss: 0.0053 - acc: 0.9985 - ETA: 1s - loss: 0.0053 - acc: 0.9985 - ETA: 1s - loss: 0.0052 - acc: 0.9985 - ETA: 1s - loss: 0.0052 - acc: 0.9985 - ETA: 1s - loss: 0.0052 - acc: 0.9985 - ETA: 1s - loss: 0.0052 - acc: 0.9985 - ETA: 0s - loss: 0.0061 - acc: 0.9984 - ETA: 0s - loss: 0.0061 - acc: 0.9984 - ETA: 0s - loss: 0.0061 - acc: 0.9984 - ETA: 0s - loss: 0.0061 - acc: 0.9984 - ETA: 0s - loss: 0.0061 - acc: 0.9984 - ETA: 0s - loss: 0.0061 - acc: 0.9984 - ETA: 0s - loss: 0.0061 - acc: 0.9984 - ETA: 0s - loss: 0.0061 - acc: 0.9984 - ETA: 0s - loss: 0.0060 - acc: 0.9984 - ETA: 0s - loss: 0.0060 - acc: 0.9984 - ETA: 0s - loss: 0.0060 - acc: 0.9984 - ETA: 0s - loss: 0.0060 - acc: 0.9984 - ETA: 0s - loss: 0.0060 - acc: 0.9984 - ETA: 0s - loss: 0.0059 - acc: 0.9984 - ETA: 0s - loss: 0.0059 - acc: 0.9985 - ETA: 0s - loss: 0.0059 - acc: 0.9985 - ETA: 0s - loss: 0.0059 - acc: 0.9985 - ETA: 0s - loss: 0.0059 - acc: 0.9985 - ETA: 0s - loss: 0.0059 - acc: 0.9985 - ETA: 0s - loss: 0.0059 - acc: 0.9985 - ETA: 0s - loss: 0.0058 - acc: 0.9985 - ETA: 0s - loss: 0.0058 - acc: 0.9985 - ETA: 0s - loss: 0.0058 - acc: 0.9985 - ETA: 0s - loss: 0.0058 - acc: 0.9985Epoch 00019: val_loss did not improve
6680/6680 [==============================] - 13s - loss: 0.0058 - acc: 0.9985 - val_loss: 0.8766 - val_acc: 0.8335
Out[66]:
<keras.callbacks.History at 0x1abf2f9a8d0>

(IMPLEMENTATION) Load the Model with the Best Validation Loss

In [67]:
### TODO: Load the model weights with the best validation loss.
my_model.load_weights('saved_models/weights.best.Resnet50.hdf5')

(IMPLEMENTATION) Test the Model

Try out your model on the test dataset of dog images. Ensure that your test accuracy is greater than 60%.

In [69]:
### TODO: Calculate classification accuracy on the test dataset.
Resnet50_predictions = [np.argmax(my_model.predict(np.expand_dims(feature, axis=0))) for feature in test_Resnet50]
test_accuracy = 100*np.sum(np.array(Resnet50_predictions)==np.argmax(test_targets, axis=1))/len(Resnet50_predictions)
print('Test accuracy: %.4f%%' % test_accuracy)

Test accuracy: 82.4163%

(IMPLEMENTATION) Predict Dog Breed with the Model

Write a function that takes an image path as input and returns the dog breed (Affenpinscher, Afghan_hound, etc) that is predicted by your model.

Similar to the analogous function in Step 5, your function should have three steps:

  1. Extract the bottleneck features corresponding to the chosen CNN model.
  2. Supply the bottleneck features as input to the model to return the predicted vector. Note that the argmax of this prediction vector gives the index of the predicted dog breed.
  3. Use the dog_names array defined in Step 0 of this notebook to return the corresponding breed.

The functions to extract the bottleneck features can be found in extract_bottleneck_features.py, and they have been imported in an earlier code cell. To obtain the bottleneck features corresponding to your chosen CNN architecture, you need to use the function

extract_{network}

where {network}, in the above filename, should be one of VGG19, Resnet50, InceptionV3, or Xception.

In [79]:
### TODO: Write a function that takes a path to an image as input
### and returns the dog breed that is predicted by the model.
def Resnet50_predict_breed(img_path):
    bottleneck_feature = extract_Resnet50(path_to_tensor(img_path))
    predict_vector = my_model.predict(bottleneck_feature)
    return dog_names[np.argmax(predict_vector)]

Step 6: Write your Algorithm

Write an algorithm that accepts a file path to an image and first determines whether the image contains a human, dog, or neither. Then,

  • if a dog is detected in the image, return the predicted breed.
  • if a human is detected in the image, return the resembling dog breed.
  • if neither is detected in the image, provide output that indicates an error.

You are welcome to write your own functions for detecting humans and dogs in images, but feel free to use the face_detector and dog_detector functions developed above. You are required to use your CNN from Step 5 to predict dog breed.

Some sample output for our algorithm is provided below, but feel free to design your own user experience!

Sample Human Output

(IMPLEMENTATION) Write your Algorithm

In [80]:
### TODO: Write your algorithm.
### Feel free to use as many code cells as needed.
from IPython.core.display import Image, display

def dog_breed_algorithm(img_path):
    display(Image(img_path,width=200,height=200))
    if dog_detector(img_path) == 1:
        print("It is a dog, breed:")
        return Resnet50_predict_breed(img_path)
    elif face_detector(img_path) == 1:
        print("it is a human, looking like: ")
        return Resnet50_predict_breed(img_path)
    else:
        return print("Nothing identified.")

Step 7: Test Your Algorithm

In this section, you will take your new algorithm for a spin! What kind of dog does the algorithm think that you look like? If you have a dog, does it predict your dog's breed accurately? If you have a cat, does it mistakenly think that your cat is a dog?

(IMPLEMENTATION) Test Your Algorithm on Sample Images!

Test your algorithm at least six images on your computer. Feel free to use any images you like. Use at least two human and two dog images.

Question 6: Is the output better than you expected :) ? Or worse :( ? Provide at least three possible points of improvement for your algorithm.

Answer: The output of the model is quite good and almost as i expected it to be. The two dogs are identified correctly. All dogs and humans are detected correctly. But there is still scope for improvement. The accuracy of the model is not the same for all dog classes. Some classes have less images in the training set. The accuracy could be improved by adding training data. For dog breeds that look very similar, the model tends to misclassify the breed. For example cocker spaniel and golden retriever. Also the architecture can be variied to reduce prediction time and even improve accuracy.

In [83]:
## TODO: Execute your algorithm from Step 6 on
## at least 6 images on your computer.
## Feel free to use as many code cells as needed.
print(dog_breed_algorithm('/Users/felix/Desktop/Felix Seckinger.png'))
print(dog_breed_algorithm('/Users/felix/Desktop/Lindemann.jpg'))
print(dog_breed_algorithm('/Users/felix/Desktop/Bewerbungsfoto.jpg'))
print(dog_breed_algorithm('/Users/felix/Desktop/Gruppenfoto.jpg'))
print(dog_breed_algorithm('/Users/felix/Desktop/Hund1.jpg'))
print(dog_breed_algorithm('/Users/felix/Desktop/Hund2.jpg'))

it is a human, looking like: 
Maltese

it is a human, looking like: 
English_toy_spaniel

it is a human, looking like: 
Black_russian_terrier

it is a human, looking like: 
Chesapeake_bay_retriever

It is a dog, breed:
Golden_retriever

It is a dog, breed:
Beagle
In [ ]: